-- Logs begin at Thu 2021-12-16 13:49:09 UTC, end at Thu 2021-12-16 15:05:06 UTC. -- Dec 16 14:18:57.193168 dv-cinder-821893-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 16 14:18:57.204190 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 14:18:57 2021] *** Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: nodename: dv-cinder-821893-3-iscsi Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: machine: x86_64 Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: clock source: unix Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: pcre jit disabled Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: detected number of CPU cores: 4 Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: current working directory: / Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: detected binary path: /usr/bin/uwsgi-core Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: your processes number limit is 47680 Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: your memory page size is 4096 bytes Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: detected max file descriptor number: 2048 Dec 16 14:18:57.206378 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: lock engine: pthread robust mutexes Dec 16 14:18:57.207233 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: thunder lock: enabled Dec 16 14:18:57.207233 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 16 14:18:57.207233 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 14:18:57.247509 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: Python main interpreter initialized at 0x5625ea0fc9c0 Dec 16 14:18:57.247509 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: python threads support enabled Dec 16 14:18:57.247509 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: your server socket listen backlog is limited to 100 connections Dec 16 14:18:57.247509 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: your mercy for graceful operations on workers is 90 seconds Dec 16 14:18:57.247917 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 14:18:57.247917 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: *** Operational MODE: preforking *** Dec 16 14:18:57.248208 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: *** uWSGI is running in multiple interpreter mode *** Dec 16 14:18:57.248208 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: spawned uWSGI master process (pid: 66101) Dec 16 14:18:57.248440 dv-cinder-821893-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 16 14:18:57.249483 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: spawned uWSGI worker 1 (pid: 66112, cores: 1) Dec 16 14:18:57.249483 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: spawned uWSGI worker 2 (pid: 66113, cores: 1) Dec 16 14:18:57.249483 dv-cinder-821893-3-iscsi devstack@keystone.service[66101]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 14:19:00.073503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:19:00.074473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:19:00.074678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:19:00.074678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:19:00.075431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] command line args: [] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:19:00.075431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:19:00.075649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] command line args: [] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:19:00.075769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ================================================================================ {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:19:00.075879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:19:00.075879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ================================================================================ {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:19:00.076108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] admin_token = **** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.076243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] admin_token = **** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.076354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] config_dir = [] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.076469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] config_dir = [] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.076592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.076718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.076837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] config_source = [] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.076948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] config_source = [] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.077064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] debug = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.077190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] debug = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.077309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.077938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.077938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.078347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.078508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.078696 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.078878 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.079038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.079204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.079367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.079548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] list_limit = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.079711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] list_limit = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.079881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] log_config_append = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.080062 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] log_config_append = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.080247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.080388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.080589 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] log_dir = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.080734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] log_dir = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.080922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] log_file = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.081049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] log_file = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.081238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.081383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.081581 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.081722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.081917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.082105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.082286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.082424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.082637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.082825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.082962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.083158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.083295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.083495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.083632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.083871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.084008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.084138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.084262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.084462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.084598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.084802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.084944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.085071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.085199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.085336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.085518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.085662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.085787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.085922 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.086072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.086215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.086351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] publish_errors = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.086476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] publish_errors = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.086610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.086742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.086875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.087014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.087138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.087323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.087462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.087596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.087730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.087855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.087989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] standard_threads = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.088126 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] standard_threads = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.088252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.088378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.088516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.088754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.089213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.089339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.089473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] use_journal = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.089607 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] use_journal = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.089740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] use_json = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.089873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] use_json = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.090054 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] use_stderr = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.090217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] use_stderr = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.090345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] use_syslog = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.090472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] use_syslog = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.090596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.090724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:19:00.090874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.091015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.091143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.091309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.091448 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.091573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.091718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.091854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.091989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.092117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.092250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.092393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.092574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.092737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.092910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.093072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.093250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.093423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.093590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.093763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.093925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.094154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.094331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.094603 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.094784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.094956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.095118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.095282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.095452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.095646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.095810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.095985 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.096165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.096327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.096488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.096667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.096831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.096995 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.097166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.097326 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.097503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.097674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.097674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.098079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.098079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.098421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.098620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.098818 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.098999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.099195 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.099390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.099572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.099759 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.099956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.100145 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.100322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.100499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.100677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.100919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.101130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.101308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.101485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.101675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.101853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.102066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.102262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.102455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.102636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.102826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.103001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.103179 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.103475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.103654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.103838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.104020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.104199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.104378 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.104574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.104753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.104930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.105112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.105290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.105477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.105668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.105971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.106255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.106435 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.106614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.106804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.106985 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.107174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.107360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.107541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.107720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.107909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.108090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.108270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.108448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.108627 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.108816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.109011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.109238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.109415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.109594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.109773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.109952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.110193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.110373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.110550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.110729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.110907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.111096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.111344 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.111505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.111668 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.111828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.111987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.112153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.112332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.112547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.112719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.112878 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.112878 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.113190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.113420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.113604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.113784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.113953 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.114183 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.114374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.114618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.114799 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.114979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.115173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.115376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.115563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.115752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.115923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.116120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.116303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.116478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.116661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.116839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.117019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.117222 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.117412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.117592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.117764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.117943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.118157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.118347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.118520 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.118701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.118873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.119042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] auth.external = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.119221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] auth.external = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.119414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.119596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.119779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.119972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.120156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.120342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.120540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] auth.password = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.120728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] auth.password = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.120911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] auth.token = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.121099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] auth.token = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.121279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.121554 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.121863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.122068 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.122250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.122429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.122612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.122806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.123008 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.123187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.123365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.123365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.123719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.123905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] credential.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.124111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.124300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.124472 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] credential.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.124651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.124833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.125030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.125208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.125390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.125572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.125756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.125943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.126203 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.126384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.126570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.126765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.126959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.127139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.127317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.127500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.127692 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.127874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.128052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.128233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.128413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.128413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.128762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.128948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.129129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.129343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.129532 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.129719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] federation.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.129910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.130123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.130304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.130484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.130663 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] federation.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.130839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.131038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.131219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.131401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.131590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.131815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.132009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.132198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.132377 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.132572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.132756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.132938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.133119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.133299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.133484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.133673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.133871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.134093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.134278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.134458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.134637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.134839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.135021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.135218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.135400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.135596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.135797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.135978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.136171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.136355 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.136535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.136718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.136910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.137093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.137381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.137565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.137746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.137938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.138160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.138344 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.138525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.138706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.138886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.139066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.139259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.139444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.139625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.139804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.139985 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.140165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.140361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.140546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.140728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.140908 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.141087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.141265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.141461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.141642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.141831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.142035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.142216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.142398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.142602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.142794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.142973 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.143153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.143333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.143513 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.143806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.144003 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.144184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.144366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.144546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.144727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.144919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.145100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.145279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.145458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.145637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.145818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.146096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.146278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.146458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.146639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.146823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.147004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.147204 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.147385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.147565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.147755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.147938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.148116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.148318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.148517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.148697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.148882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.149063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.149244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.149435 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.149625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.149807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.150011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.150193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.150374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.150573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.150755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.150938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.151118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.151299 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.151479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.151674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.151854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.152035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.152218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.152400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.152582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.152981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.152981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.153325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.153508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.153689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.153869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.154094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.154094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.154435 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.154615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.154795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.154986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.155169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.155350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.155531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.155714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.155892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.156083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.156266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.156266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.156604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.156785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.156964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.157158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.157339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.157518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.157699 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.157877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.158078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.158277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.158457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.158636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.158827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.158827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.159170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.159367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.159567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.159748 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.159928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.159928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.160266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.160462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.160644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.160823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.161003 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.161192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.161373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.161590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.161831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.162143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.162323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.162507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.162708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.162947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.163129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.163308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.163486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.163671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.163851 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.164055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.164232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.164410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.164596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.164774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.164952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.165143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.165323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.165504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.165693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.165874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.166076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.166275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.166456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.166637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.166818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.166999 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.167176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.167378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] resource.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.167558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.167739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.167917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.168170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.168377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.168576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.168758 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] resource.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.168937 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.169116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.169312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.169492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.169687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.169868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.170072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.170259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.170441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.170632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.170830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.171013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.171194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] role.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.171382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.171562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] role.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.171740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.171956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.172199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.172382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.172561 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] role.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.172750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.172929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] role.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.173125 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.173308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.173486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.173674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.173854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.174151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.174355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.174538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.174716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.174716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.175061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.175254 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.175433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.175612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.175793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.175972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.176154 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.176351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.176531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.176713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.176891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.176891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.177237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.177430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.177612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.177800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.177982 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.178198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.178395 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.178395 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.178752 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.178937 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.179116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.179299 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.179496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.179789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.179970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.180158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.180340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.180520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.180704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.180898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.181077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.181258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.181456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.181649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.181828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.182044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.182244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.182446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.182629 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.182809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.183011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.183204 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.183390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.183572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.183757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.184064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.184261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.184443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] token.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.184625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.184808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.184988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.185169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.185362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.185545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.185726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.185908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.186111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] token.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.186293 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.186492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.186679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.186860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.187041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.187221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.187402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.187600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.187782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.187962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.188144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.188324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.188503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.188697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.188879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.189060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.189239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.189418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.189600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.189795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.189977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.190178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.190359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.190539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.190720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.190927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.191108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.connection = **** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.191289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.191468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.191649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.191830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.192023 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.192204 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.192385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.192566 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.192744 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.connection = **** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.192925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.193119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.193301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.193480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.193661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.193841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.194130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.194333 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.194516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.194694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.194875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.195060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.195238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.195432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.195624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.195802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.195983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.196165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.196344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.196535 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.196718 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.196899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.197081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.197260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.197441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.197634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.197807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.198013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.198199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:19:00.198381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.198381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.198381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.198381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:19:00.198381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:19:00.199214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.199214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.199214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.199996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.199996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.199996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.200507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.200689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.222364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.222598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.223713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.223947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.279139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.279835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.331307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.331555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.332159 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.332397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.401765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.402059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.402236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.402454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.402603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.402740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.402956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.403090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.403217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.403365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.404212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.404212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.430451 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.430717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.430896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.431038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.431172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.431332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.431462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.431592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.431719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.431846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.431974 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.432115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.432115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.432342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.443844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.444634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.457746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.458030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.458214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.458358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.458497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.458652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.458772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.458886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.459011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.459133 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.459247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.459373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.459373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.459582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 16 14:19:00.477709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.477979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 16 14:19:00.478219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.478219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 16 14:19:00.478473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.478473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 16 14:19:00.478710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.478710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 16 14:19:00.478957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.479089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.479223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.479351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.479472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.479607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.479733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.479858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.490574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.490846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.490846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.491131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.491263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.491388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.491388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.491732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.500218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.500579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.503671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.503960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.504245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.504415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.504543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.504664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.504784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.504895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.505026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.505148 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.505271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.505391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.505521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.505640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.505779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.505898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.506087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.506209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.506329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.506470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.506638 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.506904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.536047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.536415 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.537757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.538061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.538193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.538349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.543527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.543987 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.544156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.544287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.544564 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.544919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.551772 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.552063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.552296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.552601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.556699 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.556998 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.557193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.557323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.557497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.557618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.557777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.557896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.558081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.558200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.558350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.558477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.558620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.558765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.558883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.559252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.577925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.578256 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.578416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.578538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.583141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.583356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.586947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.587176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.587313 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.587442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.592617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.592839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.596358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.596600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.600243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.600478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.600593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.600711 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.600863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.600982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.601099 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.601215 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.601334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.601462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.601587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.601736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.621372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.621645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.621789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.622776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.622908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.623038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.623150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.623264 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.630482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.630741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.632313 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.632456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.632572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.632703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.635641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.635922 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.636209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.636505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.636778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.641039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.641333 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.641636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.641923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.642232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.650498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.650812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.651097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.651361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.651638 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.651919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.652194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.655790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.656083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.656360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.656634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.656910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.657187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.657458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.670563 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.675236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.678532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.680135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.681713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.682014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.682282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.682475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.687308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.690879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.692599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.694363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.694672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.694925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.761182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.762930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.766217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.766510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.766790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.767074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.774552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.776147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.776373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.776685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.776963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.779455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.779752 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.780035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.780313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.785036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.785322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.785622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.785909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.786203 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.786480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.786752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.787021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.787286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.787558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.787835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.788100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.788360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.788722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.789408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.789698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.789980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.798263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 16 14:19:00.798546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.798847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.799119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.799386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.799657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.799925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.800195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.800460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.800729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.801008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.801270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.801531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.801905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 16 14:19:00.826354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x5625ea0fc9c0 pid: 66113 (default app) Dec 16 14:19:00.830125 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341516-b4e2-419b-8193-e9fa34aac073 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:00.830426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341516-b4e2-419b-8193-e9fa34aac073 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:00.830717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341516-b4e2-419b-8193-e9fa34aac073 None None] PATH_INFO: `/v3` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:00.834984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Thu Dec 16 14:19:00 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:00.844840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x5625ea0fc9c0 pid: 66112 (default app) Dec 16 14:19:06.562894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7edc4-7f4f-498c-bc47-50ca193bab3c None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:06.563424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7edc4-7f4f-498c-bc47-50ca193bab3c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:06.563424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7edc4-7f4f-498c-bc47-50ca193bab3c None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:06.565313 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:06.573929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:06.574491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:06.574567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:06.616372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG oslo_db.sqlalchemy.engines [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:19:06.767977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG passlib.handlers.bcrypt [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66112) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Dec 16 14:19:06.768392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG passlib.handlers.bcrypt [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66112) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Dec 16 14:19:06.838304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:06.838928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:06.949322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1/3] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:07.102543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7edc4-7f4f-498c-bc47-50ca193bab3c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:07.149605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG oslo_db.sqlalchemy.engines [None req-e6b7edc4-7f4f-498c-bc47-50ca193bab3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:19:07.248127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7edc4-7f4f-498c-bc47-50ca193bab3c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:07.252507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b397-7275-4409-a0e6-e4a5c0ce9f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:07.253106 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b397-7275-4409-a0e6-e4a5c0ce9f97 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:07.253391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b397-7275-4409-a0e6-e4a5c0ce9f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:07.253674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b397-7275-4409-a0e6-e4a5c0ce9f97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:07.263083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b397-7275-4409-a0e6-e4a5c0ce9f97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:07.295316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.common.rbac_enforcer.enforcer [None req-27c3b397-7275-4409-a0e6-e4a5c0ce9f97 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 16 14:19:07.295654 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b397-7275-4409-a0e6-e4a5c0ce9f97 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:07.305783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 3/4] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:19:07.312447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:07.324353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d97c3-1fa5-4cf7-92b9-ad210739ae88 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:07.329256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38291808-e04d-46f6-a57b-6057ced8143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:07.330125 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38291808-e04d-46f6-a57b-6057ced8143a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:07.330408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38291808-e04d-46f6-a57b-6057ced8143a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:07.330681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38291808-e04d-46f6-a57b-6057ced8143a admin admin] PATH_INFO: `/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:07.332081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38291808-e04d-46f6-a57b-6057ced8143a admin admin] RBAC: Authorizing `identity:get_project(project_id=5ccd5dcafb684ba88fe8fe109a2798be)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:07.365386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.common.rbac_enforcer.enforcer [None req-38291808-e04d-46f6-a57b-6057ced8143a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 16 14:19:07.365708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38291808-e04d-46f6-a57b-6057ced8143a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:07.370503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 2/5] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:07 2021] GET /identity/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be => generated 344 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:09.338030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926efd4-f552-41a9-a6b5-d92d8835c4ba None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:09.338642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926efd4-f552-41a9-a6b5-d92d8835c4ba None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:09.338642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926efd4-f552-41a9-a6b5-d92d8835c4ba None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:09.343002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 4/6] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:09.348562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2c26-4b56-4d34-8e7a-b3841937dcab None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:09.349002 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2c26-4b56-4d34-8e7a-b3841937dcab None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:09.349099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2c26-4b56-4d34-8e7a-b3841937dcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:09.374007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4fef2c26-4b56-4d34-8e7a-b3841937dcab None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:09.375556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4fef2c26-4b56-4d34-8e7a-b3841937dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:09.384392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 3/7] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:09.407752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926efd4-f552-41a9-a6b5-d92d8835c4ba None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:09.421072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926efd4-f552-41a9-a6b5-d92d8835c4ba None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:09.424875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9173b-cfd3-47be-9bb4-0508160403d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:09.425467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9173b-cfd3-47be-9bb4-0508160403d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:09.425750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9173b-cfd3-47be-9bb4-0508160403d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:09.426050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9173b-cfd3-47be-9bb4-0508160403d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:09.434782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9173b-cfd3-47be-9bb4-0508160403d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:09.463458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9173b-cfd3-47be-9bb4-0508160403d4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:09.473039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 5/8] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:19:09.479171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2c26-4b56-4d34-8e7a-b3841937dcab None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:09.488720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2c26-4b56-4d34-8e7a-b3841937dcab None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:09.494928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43f697-e90f-4a3c-bcde-17d2274f7b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:09.495800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43f697-e90f-4a3c-bcde-17d2274f7b0d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:09.496088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43f697-e90f-4a3c-bcde-17d2274f7b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:09.496367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43f697-e90f-4a3c-bcde-17d2274f7b0d admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:09.497775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43f697-e90f-4a3c-bcde-17d2274f7b0d admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:09.526409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43f697-e90f-4a3c-bcde-17d2274f7b0d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:09.527993 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 4/9] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:09 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:11.510574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4632d6-d5ad-401c-8ce4-ad2fbb82765a None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:11.511134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4632d6-d5ad-401c-8ce4-ad2fbb82765a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:11.511134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4632d6-d5ad-401c-8ce4-ad2fbb82765a None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:11.512724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:11.518121 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87dcc1-f27d-48a6-b1f1-52c288c2afce None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:11.518573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87dcc1-f27d-48a6-b1f1-52c288c2afce None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:11.518677 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87dcc1-f27d-48a6-b1f1-52c288c2afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:11.542802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3a87dcc1-f27d-48a6-b1f1-52c288c2afce None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:11.543959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3a87dcc1-f27d-48a6-b1f1-52c288c2afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:11.551551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 5/11] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:11.574300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4632d6-d5ad-401c-8ce4-ad2fbb82765a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:11.587694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4632d6-d5ad-401c-8ce4-ad2fbb82765a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:11.592173 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67afbf0-3a83-465c-9843-dce65582aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:11.592897 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67afbf0-3a83-465c-9843-dce65582aebb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:11.593164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67afbf0-3a83-465c-9843-dce65582aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:11.593470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67afbf0-3a83-465c-9843-dce65582aebb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:11.607151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67afbf0-3a83-465c-9843-dce65582aebb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:11.613632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-a67afbf0-3a83-465c-9843-dce65582aebb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:19:11.615075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 7/12] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:19:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:11.621342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87dcc1-f27d-48a6-b1f1-52c288c2afce None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:11.630483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87dcc1-f27d-48a6-b1f1-52c288c2afce None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:11.634847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:11.635469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:11.635761 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:11.636049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:11.636784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:11.637094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:11.662297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:11.662297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:19:11.662297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:19:11.663239 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:11.675262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 6/13] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:11.681925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67afbf0-3a83-465c-9843-dce65582aebb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:11.692721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67afbf0-3a83-465c-9843-dce65582aebb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:11.698509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf496c2-d4d7-4509-aaea-ef997327f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:11.699342 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf496c2-d4d7-4509-aaea-ef997327f96f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:11.699630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf496c2-d4d7-4509-aaea-ef997327f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:11.699942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf496c2-d4d7-4509-aaea-ef997327f96f admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:11.701583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf496c2-d4d7-4509-aaea-ef997327f96f admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:11.727823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf496c2-d4d7-4509-aaea-ef997327f96f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:11.729359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 8/14] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:11 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:11.735575 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:11.746536 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f225c4-746f-4167-861e-ea62d6ab5d0f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:11.750789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43831a3-071c-4a76-a689-2616919d1384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:11.751516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43831a3-071c-4a76-a689-2616919d1384 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:11.751804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43831a3-071c-4a76-a689-2616919d1384 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:11.752083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43831a3-071c-4a76-a689-2616919d1384 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:11.753153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43831a3-071c-4a76-a689-2616919d1384 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:11.778865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43831a3-071c-4a76-a689-2616919d1384 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:11.780351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 7/15] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:19:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:11.786817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf496c2-d4d7-4509-aaea-ef997327f96f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:11.796901 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf496c2-d4d7-4509-aaea-ef997327f96f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:11.802152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e69fe-2610-4b09-8171-0faed451a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:11.802739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e69fe-2610-4b09-8171-0faed451a052 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:11.803026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e69fe-2610-4b09-8171-0faed451a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:11.803302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e69fe-2610-4b09-8171-0faed451a052 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:11.804086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e69fe-2610-4b09-8171-0faed451a052 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.domain.id=default, user.id=69b3dce5d565425ca928deea4c6b8503) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:11.804386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e69fe-2610-4b09-8171-0faed451a052 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:11.830035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-d20e69fe-2610-4b09-8171-0faed451a052 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:11.830035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:19:11.830035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:19:11.831285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e69fe-2610-4b09-8171-0faed451a052 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:11.840949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 9/16] 10.222.0.67 () {56 vars in 1343 bytes} [Thu Dec 16 14:19:11 2021] GET /identity/v3/role_assignments?user.id=69b3dce5d565425ca928deea4c6b8503&scope.domain.id=default&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 233 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:13.789906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fc95a-c6c9-4d5a-8eb3-8eee774efd3e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:13.790566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fc95a-c6c9-4d5a-8eb3-8eee774efd3e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:13.790566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fc95a-c6c9-4d5a-8eb3-8eee774efd3e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:13.792664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 8/17] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:13.798458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379988f-6cfb-454b-890b-8b73754deaf8 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:13.798962 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379988f-6cfb-454b-890b-8b73754deaf8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:13.799063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379988f-6cfb-454b-890b-8b73754deaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:13.833296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG passlib.handlers.bcrypt [None req-c379988f-6cfb-454b-890b-8b73754deaf8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66113) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Dec 16 14:19:13.833732 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG passlib.handlers.bcrypt [None req-c379988f-6cfb-454b-890b-8b73754deaf8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66113) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Dec 16 14:19:13.880981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c379988f-6cfb-454b-890b-8b73754deaf8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:13.882654 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c379988f-6cfb-454b-890b-8b73754deaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:13.890527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 10/18] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:13.913621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fc95a-c6c9-4d5a-8eb3-8eee774efd3e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:13.927744 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fc95a-c6c9-4d5a-8eb3-8eee774efd3e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:13.932673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a9da-21a5-4652-b079-188a101403b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:13.933415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a9da-21a5-4652-b079-188a101403b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:13.933705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a9da-21a5-4652-b079-188a101403b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:13.934008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a9da-21a5-4652-b079-188a101403b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:13.947565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068a9da-21a5-4652-b079-188a101403b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:13.954459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-3068a9da-21a5-4652-b079-188a101403b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:19:13.956061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 9/19] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:19:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:13.962592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379988f-6cfb-454b-890b-8b73754deaf8 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:13.972510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379988f-6cfb-454b-890b-8b73754deaf8 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:13.978127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:13.978763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:13.979057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:13.979318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:13.980061 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:13.980375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:14.005182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:14.005182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:19:14.005182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:19:14.006156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:14.016885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 11/20] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:14.022948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a9da-21a5-4652-b079-188a101403b6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:14.033826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a9da-21a5-4652-b079-188a101403b6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:14.039873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08ef8b-40f1-4c2a-b025-851ee94f3f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:14.040780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ef8b-40f1-4c2a-b025-851ee94f3f3c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:14.041010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ef8b-40f1-4c2a-b025-851ee94f3f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:14.041300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ef8b-40f1-4c2a-b025-851ee94f3f3c admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:14.042584 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08ef8b-40f1-4c2a-b025-851ee94f3f3c admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:14.068794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08ef8b-40f1-4c2a-b025-851ee94f3f3c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:14.070455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 10/21] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:14 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:14.076434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:14.087098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee82908-7d4c-490e-a686-29a241a19d2f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:14.092437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb155f-bc1f-455d-89b3-b75612b059b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:14.093191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb155f-bc1f-455d-89b3-b75612b059b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:14.093478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb155f-bc1f-455d-89b3-b75612b059b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:14.093761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb155f-bc1f-455d-89b3-b75612b059b7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:14.095099 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb155f-bc1f-455d-89b3-b75612b059b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:14.120426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb155f-bc1f-455d-89b3-b75612b059b7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:14.122041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 12/22] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:19:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:14.127955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08ef8b-40f1-4c2a-b025-851ee94f3f3c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:14.138254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08ef8b-40f1-4c2a-b025-851ee94f3f3c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:14.143578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe2dba-bfc2-45c3-bb75-f18da0299416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:14.144429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe2dba-bfc2-45c3-bb75-f18da0299416 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:14.144787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe2dba-bfc2-45c3-bb75-f18da0299416 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:14.145010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe2dba-bfc2-45c3-bb75-f18da0299416 admin admin] PATH_INFO: `/v3/domains/default/users/69b3dce5d565425ca928deea4c6b8503/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:14.147228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe2dba-bfc2-45c3-bb75-f18da0299416 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=69b3dce5d565425ca928deea4c6b8503, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:14.171728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-f7fe2dba-bfc2-45c3-bb75-f18da0299416 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:14.171728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:19:14.171728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:19:14.173773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe2dba-bfc2-45c3-bb75-f18da0299416 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:14.371415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 11/23] 10.222.0.67 () {58 vars in 1382 bytes} [Thu Dec 16 14:19:14 2021] PUT /identity/v3/domains/default/users/69b3dce5d565425ca928deea4c6b8503/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:19:16.382150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93ed50-c6f3-4b90-8414-4fc91585ef4b None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:16.382711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93ed50-c6f3-4b90-8414-4fc91585ef4b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:16.382711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93ed50-c6f3-4b90-8414-4fc91585ef4b None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:16.384390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:16.390874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223ade5-bedd-4819-b491-eeafeb41c9b4 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:16.391320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223ade5-bedd-4819-b491-eeafeb41c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:16.391435 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223ade5-bedd-4819-b491-eeafeb41c9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:16.417355 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-7223ade5-bedd-4819-b491-eeafeb41c9b4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:16.418910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7223ade5-bedd-4819-b491-eeafeb41c9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:16.490548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 12/25] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:16.513615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93ed50-c6f3-4b90-8414-4fc91585ef4b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:16.526796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93ed50-c6f3-4b90-8414-4fc91585ef4b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:16.531488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af926ab-6ef5-4368-ab44-f908106eadb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:16.532220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af926ab-6ef5-4368-ab44-f908106eadb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:16.532741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af926ab-6ef5-4368-ab44-f908106eadb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:16.533048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af926ab-6ef5-4368-ab44-f908106eadb5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:16.546447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af926ab-6ef5-4368-ab44-f908106eadb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:16.552877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-7af926ab-6ef5-4368-ab44-f908106eadb5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:19:16.554020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 14/26] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:19:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:16.560820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223ade5-bedd-4819-b491-eeafeb41c9b4 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:16.570963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223ade5-bedd-4819-b491-eeafeb41c9b4 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:16.576328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae395d-bb32-453b-b5f7-44fecd39e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:16.576956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae395d-bb32-453b-b5f7-44fecd39e116 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:16.577246 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae395d-bb32-453b-b5f7-44fecd39e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:16.577528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae395d-bb32-453b-b5f7-44fecd39e116 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:16.578616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae395d-bb32-453b-b5f7-44fecd39e116 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:16.578917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae395d-bb32-453b-b5f7-44fecd39e116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:16.604691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae395d-bb32-453b-b5f7-44fecd39e116 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:16.619434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 13/27] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:16.626155 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af926ab-6ef5-4368-ab44-f908106eadb5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:16.635933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af926ab-6ef5-4368-ab44-f908106eadb5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:16.640044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d60285-127b-45fd-bb5a-d7a5f49835de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:16.640852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d60285-127b-45fd-bb5a-d7a5f49835de admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:16.641189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d60285-127b-45fd-bb5a-d7a5f49835de admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:16.641422 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d60285-127b-45fd-bb5a-d7a5f49835de admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:16.642670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d60285-127b-45fd-bb5a-d7a5f49835de admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:16.667919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d60285-127b-45fd-bb5a-d7a5f49835de admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:16.669502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 15/28] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:16 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:16.675460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae395d-bb32-453b-b5f7-44fecd39e116 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:16.685578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae395d-bb32-453b-b5f7-44fecd39e116 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:16.691095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf8e6b-799f-4101-ad5a-1610acbf4172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:16.691852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf8e6b-799f-4101-ad5a-1610acbf4172 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:16.692137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf8e6b-799f-4101-ad5a-1610acbf4172 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:16.692398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf8e6b-799f-4101-ad5a-1610acbf4172 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:16.693796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf8e6b-799f-4101-ad5a-1610acbf4172 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:16.719455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf8e6b-799f-4101-ad5a-1610acbf4172 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:16.721046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 14/29] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:19:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:19:16.727389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d60285-127b-45fd-bb5a-d7a5f49835de admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:16.737632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d60285-127b-45fd-bb5a-d7a5f49835de admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:16.742944 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5023f06-f942-4751-96df-0a1d76dea4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:16.743531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5023f06-f942-4751-96df-0a1d76dea4ee admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:16.743815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5023f06-f942-4751-96df-0a1d76dea4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:16.744098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5023f06-f942-4751-96df-0a1d76dea4ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:16.744880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5023f06-f942-4751-96df-0a1d76dea4ee admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.domain.id=default, user.id=69b3dce5d565425ca928deea4c6b8503) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:16.745189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5023f06-f942-4751-96df-0a1d76dea4ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:16.770573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5023f06-f942-4751-96df-0a1d76dea4ee admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:16.777069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 16/30] 10.222.0.67 () {56 vars in 1343 bytes} [Thu Dec 16 14:19:16 2021] GET /identity/v3/role_assignments?user.id=69b3dce5d565425ca928deea4c6b8503&scope.domain.id=default&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 530 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:18.809021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a02ae-e4e3-41ca-bf36-27c0fda89d3f None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:18.809622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a02ae-e4e3-41ca-bf36-27c0fda89d3f None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:18.809622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a02ae-e4e3-41ca-bf36-27c0fda89d3f None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:18.811333 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 15/31] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:18.817468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d781a5-32aa-4910-9788-c24137fc8808 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:18.817889 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d781a5-32aa-4910-9788-c24137fc8808 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:18.818017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d781a5-32aa-4910-9788-c24137fc8808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:18.842696 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-93d781a5-32aa-4910-9788-c24137fc8808 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:18.844132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-93d781a5-32aa-4910-9788-c24137fc8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:18.852520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 17/32] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:18.874985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a02ae-e4e3-41ca-bf36-27c0fda89d3f None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:18.888228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a02ae-e4e3-41ca-bf36-27c0fda89d3f None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:18.893520 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3dbd32-3e1e-43e8-a57e-6915f4c5d2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:18.894130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dbd32-3e1e-43e8-a57e-6915f4c5d2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:18.894418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dbd32-3e1e-43e8-a57e-6915f4c5d2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:18.894697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dbd32-3e1e-43e8-a57e-6915f4c5d2b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:18.903029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3dbd32-3e1e-43e8-a57e-6915f4c5d2b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:18.928356 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3dbd32-3e1e-43e8-a57e-6915f4c5d2b6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:18.937595 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 16/33] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:19:18.943478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d781a5-32aa-4910-9788-c24137fc8808 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:18.953076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d781a5-32aa-4910-9788-c24137fc8808 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:18.958434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d79441-9394-4432-8623-805a80f15b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:18.959176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d79441-9394-4432-8623-805a80f15b6f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:18.959460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d79441-9394-4432-8623-805a80f15b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:18.959739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d79441-9394-4432-8623-805a80f15b6f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:18.960934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d79441-9394-4432-8623-805a80f15b6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:18.986366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d79441-9394-4432-8623-805a80f15b6f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:18.987916 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 18/34] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:19:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:21.055573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd312e3-5633-483a-81f0-1171290d23d0 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:21.056192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd312e3-5633-483a-81f0-1171290d23d0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:21.056192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd312e3-5633-483a-81f0-1171290d23d0 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:21.057850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 17/35] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:21.063943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ca881-9e60-4353-8378-26cc86439192 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:21.064387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ca881-9e60-4353-8378-26cc86439192 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:21.064470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ca881-9e60-4353-8378-26cc86439192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:21.090111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-752ca881-9e60-4353-8378-26cc86439192 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:21.091303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-752ca881-9e60-4353-8378-26cc86439192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:21.098180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 19/36] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:21.121632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd312e3-5633-483a-81f0-1171290d23d0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:21.135132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd312e3-5633-483a-81f0-1171290d23d0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:21.140046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07143548-a45d-47fd-ad68-26d32f44b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:21.140780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07143548-a45d-47fd-ad68-26d32f44b447 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:21.141071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07143548-a45d-47fd-ad68-26d32f44b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:21.141361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07143548-a45d-47fd-ad68-26d32f44b447 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:21.154190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07143548-a45d-47fd-ad68-26d32f44b447 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:21.180195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07143548-a45d-47fd-ad68-26d32f44b447 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:21.198613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-07143548-a45d-47fd-ad68-26d32f44b447 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:19:21.200146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 18/37] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:19:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:21.206879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ca881-9e60-4353-8378-26cc86439192 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:21.215992 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ca881-9e60-4353-8378-26cc86439192 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:21.221629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890e423-c133-4c6b-bafa-0304482d5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:21.222255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e423-c133-4c6b-bafa-0304482d5b07 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:21.222536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e423-c133-4c6b-bafa-0304482d5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:21.222809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e423-c133-4c6b-bafa-0304482d5b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:21.223506 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890e423-c133-4c6b-bafa-0304482d5b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:21.223813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890e423-c133-4c6b-bafa-0304482d5b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:21.248817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-1890e423-c133-4c6b-bafa-0304482d5b07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:21.248817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:19:21.248817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:19:21.249730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890e423-c133-4c6b-bafa-0304482d5b07 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:21.266557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:19:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:21.272443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07143548-a45d-47fd-ad68-26d32f44b447 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:21.282566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07143548-a45d-47fd-ad68-26d32f44b447 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:21.287850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8f79-9384-4d35-85f2-9a75e54b127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:21.288444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8f79-9384-4d35-85f2-9a75e54b127b admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:21.288752 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8f79-9384-4d35-85f2-9a75e54b127b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:21.289035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8f79-9384-4d35-85f2-9a75e54b127b admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:21.289692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a8f79-9384-4d35-85f2-9a75e54b127b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:21.315960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-3b3a8f79-9384-4d35-85f2-9a75e54b127b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:21.315960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:19:21.315960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:19:21.317129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a8f79-9384-4d35-85f2-9a75e54b127b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:21.355595 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:19:21 2021] POST /identity/v3/projects => generated 301 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:19:23.350985 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50e2a-8798-4c7c-8b6d-df53465e0c41 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:23.351520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50e2a-8798-4c7c-8b6d-df53465e0c41 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:23.351520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50e2a-8798-4c7c-8b6d-df53465e0c41 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:23.353237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 21/40] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:23.358644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7b25-457d-44ae-853e-063b36730765 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:23.359055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7b25-457d-44ae-853e-063b36730765 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:23.359210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7b25-457d-44ae-853e-063b36730765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:23.383049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b16d7b25-457d-44ae-853e-063b36730765 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:23.384203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b16d7b25-457d-44ae-853e-063b36730765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:23.451263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 20/41] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:23.473236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50e2a-8798-4c7c-8b6d-df53465e0c41 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:23.486407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50e2a-8798-4c7c-8b6d-df53465e0c41 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:23.491094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2b8e6-cb87-4324-8012-525a6d768c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:23.491709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2b8e6-cb87-4324-8012-525a6d768c59 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:23.491990 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2b8e6-cb87-4324-8012-525a6d768c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:23.492260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2b8e6-cb87-4324-8012-525a6d768c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:23.492959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2b8e6-cb87-4324-8012-525a6d768c59 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:23.517766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-58f2b8e6-cb87-4324-8012-525a6d768c59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:23.517766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:19:23.517766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:19:23.518708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2b8e6-cb87-4324-8012-525a6d768c59 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:23.721670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:19:23 2021] POST /identity/v3/roles => generated 219 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:19:25.682846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a8dc7-226f-420c-885c-53bb322b2905 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:25.683427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a8dc7-226f-420c-885c-53bb322b2905 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:25.683427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a8dc7-226f-420c-885c-53bb322b2905 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:25.685143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 21/43] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:25.691016 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f9f01-4f36-40e8-bca1-abf53c520b1c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:25.691448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f9f01-4f36-40e8-bca1-abf53c520b1c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:25.691543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f9f01-4f36-40e8-bca1-abf53c520b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:25.717620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c31f9f01-4f36-40e8-bca1-abf53c520b1c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:25.719138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c31f9f01-4f36-40e8-bca1-abf53c520b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:25.731729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 23/44] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:25.759650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a8dc7-226f-420c-885c-53bb322b2905 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:25.774283 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a8dc7-226f-420c-885c-53bb322b2905 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:25.779958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e413a-decf-44ea-96b3-d50e2549acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:25.780554 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e413a-decf-44ea-96b3-d50e2549acf3 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:25.780839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e413a-decf-44ea-96b3-d50e2549acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:25.781122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e413a-decf-44ea-96b3-d50e2549acf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:25.781825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e413a-decf-44ea-96b3-d50e2549acf3 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:25.806293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-6b4e413a-decf-44ea-96b3-d50e2549acf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:25.806293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:19:25.806293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:19:25.807208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e413a-decf-44ea-96b3-d50e2549acf3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:25.824236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:19:25 2021] POST /identity/v3/roles => generated 225 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:19:27.836898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a647-70d2-4d94-895f-73fdff0ce539 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:27.837446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a647-70d2-4d94-895f-73fdff0ce539 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:27.837446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a647-70d2-4d94-895f-73fdff0ce539 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:27.839398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 24/46] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:27.844847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df57b7-e26c-4f76-a2b5-bbebf4ec19c9 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:27.845427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df57b7-e26c-4f76-a2b5-bbebf4ec19c9 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:27.845427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df57b7-e26c-4f76-a2b5-bbebf4ec19c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:27.869794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-a4df57b7-e26c-4f76-a2b5-bbebf4ec19c9 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:27.870981 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a4df57b7-e26c-4f76-a2b5-bbebf4ec19c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:27.878725 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 23/47] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:27.901271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433a647-70d2-4d94-895f-73fdff0ce539 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:27.914966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433a647-70d2-4d94-895f-73fdff0ce539 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:27.920561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a999dc1-5b41-40b5-abb9-3c6a76f72986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:27.921180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a999dc1-5b41-40b5-abb9-3c6a76f72986 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:27.921498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a999dc1-5b41-40b5-abb9-3c6a76f72986 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:27.921783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a999dc1-5b41-40b5-abb9-3c6a76f72986 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:27.922539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a999dc1-5b41-40b5-abb9-3c6a76f72986 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:27.949287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a999dc1-5b41-40b5-abb9-3c6a76f72986 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:27.964555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 25/48] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:19:27 2021] POST /identity/v3/roles => generated 223 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:19:29.908320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e6bf-68bf-4e02-84e2-9ba909551e9c None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:29.908892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e6bf-68bf-4e02-84e2-9ba909551e9c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:29.908892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e6bf-68bf-4e02-84e2-9ba909551e9c None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:29.910692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 24/49] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:29.916011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcf43b-b414-45dd-a1d8-9da2b75701f8 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:29.916452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcf43b-b414-45dd-a1d8-9da2b75701f8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:29.916580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcf43b-b414-45dd-a1d8-9da2b75701f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:29.940779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-03dcf43b-b414-45dd-a1d8-9da2b75701f8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:29.941945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-03dcf43b-b414-45dd-a1d8-9da2b75701f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:29.950605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 26/50] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:29.973342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1e6bf-68bf-4e02-84e2-9ba909551e9c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:29.987189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1e6bf-68bf-4e02-84e2-9ba909551e9c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:29.992294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8028b1-8446-4af8-9d21-598ea1af536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:29.993315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8028b1-8446-4af8-9d21-598ea1af536e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:29.993603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8028b1-8446-4af8-9d21-598ea1af536e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:29.993888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8028b1-8446-4af8-9d21-598ea1af536e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:29.995075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8028b1-8446-4af8-9d21-598ea1af536e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:30.020099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8028b1-8446-4af8-9d21-598ea1af536e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:30.021637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 25/51] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:19:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:30.027684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcf43b-b414-45dd-a1d8-9da2b75701f8 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:30.037111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcf43b-b414-45dd-a1d8-9da2b75701f8 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:30.042590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbd0f3-872a-4da9-bce7-7f5b27335a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:30.043242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd0f3-872a-4da9-bce7-7f5b27335a74 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:30.043530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd0f3-872a-4da9-bce7-7f5b27335a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:30.043811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbd0f3-872a-4da9-bce7-7f5b27335a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:30.044675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbd0f3-872a-4da9-bce7-7f5b27335a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:30.069819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-c7bbd0f3-872a-4da9-bce7-7f5b27335a74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:30.069819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:19:30.069819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:19:30.071121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbd0f3-872a-4da9-bce7-7f5b27335a74 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:30.104586 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:19:30 2021] POST /identity/v3/projects => generated 312 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:19:32.112644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087fad-86a4-4db5-b0a7-b0686c8d9e41 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:32.113199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087fad-86a4-4db5-b0a7-b0686c8d9e41 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:32.113199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087fad-86a4-4db5-b0a7-b0686c8d9e41 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:32.115031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 26/53] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:32.120837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0add7e8-fc53-424d-af39-ff915b4771cf None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:32.121276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0add7e8-fc53-424d-af39-ff915b4771cf None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:32.121356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0add7e8-fc53-424d-af39-ff915b4771cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:32.148517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-e0add7e8-fc53-424d-af39-ff915b4771cf None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:32.149664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e0add7e8-fc53-424d-af39-ff915b4771cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:32.219913 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 28/54] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:19:32.243064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32087fad-86a4-4db5-b0a7-b0686c8d9e41 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:32.256799 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32087fad-86a4-4db5-b0a7-b0686c8d9e41 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:32.261749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b10f6-40d6-4902-9445-a81972eadaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:32.262519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b10f6-40d6-4902-9445-a81972eadaba admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:32.262811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b10f6-40d6-4902-9445-a81972eadaba admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:32.263080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b10f6-40d6-4902-9445-a81972eadaba admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:32.264207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b10f6-40d6-4902-9445-a81972eadaba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:32.289566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b10f6-40d6-4902-9445-a81972eadaba admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:32.291063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:19:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:32.296883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0add7e8-fc53-424d-af39-ff915b4771cf None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:32.306217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0add7e8-fc53-424d-af39-ff915b4771cf None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:32.311471 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe14dd-9e09-4160-b169-e481b6b76cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:32.312061 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe14dd-9e09-4160-b169-e481b6b76cbd admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:32.312346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe14dd-9e09-4160-b169-e481b6b76cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:32.312620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe14dd-9e09-4160-b169-e481b6b76cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:32.313274 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe14dd-9e09-4160-b169-e481b6b76cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:32.339395 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe14dd-9e09-4160-b169-e481b6b76cbd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:32.368182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 29/56] 10.222.0.67 () {60 vars in 1161 bytes} [Thu Dec 16 14:19:32 2021] POST /identity/v3/projects => generated 298 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:19:34.358608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7341e3-225f-4582-a81c-b41d543dd7ec None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:34.359163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7341e3-225f-4582-a81c-b41d543dd7ec None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:34.359163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7341e3-225f-4582-a81c-b41d543dd7ec None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:34.360912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 28/57] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:34.366466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb34f-1545-4182-aa3a-2dbc52f88968 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:34.366884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb34f-1545-4182-aa3a-2dbc52f88968 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:34.367044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb34f-1545-4182-aa3a-2dbc52f88968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:34.390526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-51edb34f-1545-4182-aa3a-2dbc52f88968 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:34.391625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-51edb34f-1545-4182-aa3a-2dbc52f88968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:34.460956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 30/58] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:34.485104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7341e3-225f-4582-a81c-b41d543dd7ec None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:34.497730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7341e3-225f-4582-a81c-b41d543dd7ec None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:34.502153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c617b-1cd6-4fba-a6dd-3dab54126641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:34.502935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c617b-1cd6-4fba-a6dd-3dab54126641 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:34.503224 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c617b-1cd6-4fba-a6dd-3dab54126641 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:34.503493 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c617b-1cd6-4fba-a6dd-3dab54126641 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:34.504598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c617b-1cd6-4fba-a6dd-3dab54126641 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:34.530043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c617b-1cd6-4fba-a6dd-3dab54126641 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:34.531659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:19:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:34.537681 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edb34f-1545-4182-aa3a-2dbc52f88968 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:34.547152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edb34f-1545-4182-aa3a-2dbc52f88968 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:34.552507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179009b-f5ec-433f-83dc-b446b0bdead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:34.553201 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179009b-f5ec-433f-83dc-b446b0bdead2 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:34.553491 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179009b-f5ec-433f-83dc-b446b0bdead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:34.553771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179009b-f5ec-433f-83dc-b446b0bdead2 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:34.554460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179009b-f5ec-433f-83dc-b446b0bdead2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:34.579595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-0179009b-f5ec-433f-83dc-b446b0bdead2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:34.579595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:19:34.579595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:19:34.580843 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179009b-f5ec-433f-83dc-b446b0bdead2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:34.605852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 31/60] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:19:34 2021] POST /identity/v3/users => generated 275 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:19:36.577278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9b40-6b56-4617-9d8a-b17f2765b9d7 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:36.578082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9b40-6b56-4617-9d8a-b17f2765b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:36.578082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9b40-6b56-4617-9d8a-b17f2765b9d7 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:36.580746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 30/61] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:36.588593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b061e0-bfc2-4a0f-afe1-9a0e4ca1fef6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:36.589088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b061e0-bfc2-4a0f-afe1-9a0e4ca1fef6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:36.589177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b061e0-bfc2-4a0f-afe1-9a0e4ca1fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:36.612015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b9b061e0-bfc2-4a0f-afe1-9a0e4ca1fef6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:36.613122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b9b061e0-bfc2-4a0f-afe1-9a0e4ca1fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:36.620990 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 32/62] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:19:36.652544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b9b40-6b56-4617-9d8a-b17f2765b9d7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:36.666484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b9b40-6b56-4617-9d8a-b17f2765b9d7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:36.671303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845d4a4-5e5d-4217-b380-947eb327df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:36.672045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d4a4-5e5d-4217-b380-947eb327df60 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:36.672332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d4a4-5e5d-4217-b380-947eb327df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:36.672614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d4a4-5e5d-4217-b380-947eb327df60 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:36.686160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845d4a4-5e5d-4217-b380-947eb327df60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:36.693778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-c845d4a4-5e5d-4217-b380-947eb327df60 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:19:36.695024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 31/63] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:36.701354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b061e0-bfc2-4a0f-afe1-9a0e4ca1fef6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:36.710800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b061e0-bfc2-4a0f-afe1-9a0e4ca1fef6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:36.716554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adc9ac-fdda-452a-9ae6-1cf2f5413a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:36.717172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adc9ac-fdda-452a-9ae6-1cf2f5413a94 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:36.717461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adc9ac-fdda-452a-9ae6-1cf2f5413a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:36.717732 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adc9ac-fdda-452a-9ae6-1cf2f5413a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:36.718512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adc9ac-fdda-452a-9ae6-1cf2f5413a94 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:36.718807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adc9ac-fdda-452a-9ae6-1cf2f5413a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:36.743934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adc9ac-fdda-452a-9ae6-1cf2f5413a94 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:36.753239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 33/64] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:19:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:36.760187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845d4a4-5e5d-4217-b380-947eb327df60 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:36.777629 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845d4a4-5e5d-4217-b380-947eb327df60 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:36.782401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e8263-a6ce-4a20-9398-bd73c091bdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:36.783302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e8263-a6ce-4a20-9398-bd73c091bdbd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:36.783645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e8263-a6ce-4a20-9398-bd73c091bdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:36.783971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e8263-a6ce-4a20-9398-bd73c091bdbd admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:36.805562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e8263-a6ce-4a20-9398-bd73c091bdbd admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:36.831932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e8263-a6ce-4a20-9398-bd73c091bdbd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:36.833700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 32/65] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:36 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:36.839571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adc9ac-fdda-452a-9ae6-1cf2f5413a94 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:36.849712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adc9ac-fdda-452a-9ae6-1cf2f5413a94 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:36.854571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41605409-1e46-4fe1-8210-6da0c9ea3896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:36.855154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41605409-1e46-4fe1-8210-6da0c9ea3896 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:36.855443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41605409-1e46-4fe1-8210-6da0c9ea3896 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:36.855720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41605409-1e46-4fe1-8210-6da0c9ea3896 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:36.863942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41605409-1e46-4fe1-8210-6da0c9ea3896 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:36.890861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41605409-1e46-4fe1-8210-6da0c9ea3896 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:36.901084 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 34/66] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:19:36.907623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e8263-a6ce-4a20-9398-bd73c091bdbd admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:36.918698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e8263-a6ce-4a20-9398-bd73c091bdbd admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:36.923102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07971c-57ba-4cb6-bb1a-bff7dde3f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:36.923895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07971c-57ba-4cb6-bb1a-bff7dde3f997 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:36.924184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07971c-57ba-4cb6-bb1a-bff7dde3f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:36.924463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07971c-57ba-4cb6-bb1a-bff7dde3f997 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:36.925596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07971c-57ba-4cb6-bb1a-bff7dde3f997 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:36.951837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07971c-57ba-4cb6-bb1a-bff7dde3f997 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:36.953371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 33/67] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:36 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:36.959403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41605409-1e46-4fe1-8210-6da0c9ea3896 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:36.969347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41605409-1e46-4fe1-8210-6da0c9ea3896 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:36.975305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f9e6f-8410-4098-abec-93196c911ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:36.975914 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f9e6f-8410-4098-abec-93196c911ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:36.976205 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f9e6f-8410-4098-abec-93196c911ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:36.976468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f9e6f-8410-4098-abec-93196c911ab0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:36.977279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f9e6f-8410-4098-abec-93196c911ab0 admin admin] RBAC: Adding query filter params (role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d, user.id=fd2894712b85445fbc68a4343ad9d3bf) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:36.977577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f9e6f-8410-4098-abec-93196c911ab0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:37.003706 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f9e6f-8410-4098-abec-93196c911ab0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:37.010852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 35/68] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:19:36 2021] GET /identity/v3/role_assignments?user.id=fd2894712b85445fbc68a4343ad9d3bf&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:39.023138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedfa8f-f7a3-43a2-b92d-05953c62dc71 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:39.023806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedfa8f-f7a3-43a2-b92d-05953c62dc71 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:39.023806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedfa8f-f7a3-43a2-b92d-05953c62dc71 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:39.025424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 34/69] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:39.031002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3db54-9abc-46f5-8a9d-4d922706a388 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:39.031462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3db54-9abc-46f5-8a9d-4d922706a388 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:39.031553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3db54-9abc-46f5-8a9d-4d922706a388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:39.055124 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-44f3db54-9abc-46f5-8a9d-4d922706a388 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:39.056321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-44f3db54-9abc-46f5-8a9d-4d922706a388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:39.065153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 36/70] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:39.093219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedfa8f-f7a3-43a2-b92d-05953c62dc71 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:39.110272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedfa8f-f7a3-43a2-b92d-05953c62dc71 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:39.115447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ca26b-004a-4d9c-bdf8-1f1f3b4b4706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:39.116193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ca26b-004a-4d9c-bdf8-1f1f3b4b4706 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:39.116484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ca26b-004a-4d9c-bdf8-1f1f3b4b4706 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:39.116768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ca26b-004a-4d9c-bdf8-1f1f3b4b4706 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:39.130722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ca26b-004a-4d9c-bdf8-1f1f3b4b4706 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:39.137320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-212ca26b-004a-4d9c-bdf8-1f1f3b4b4706 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:19:39.138546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 35/71] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:39.146601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3db54-9abc-46f5-8a9d-4d922706a388 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:39.156710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3db54-9abc-46f5-8a9d-4d922706a388 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:39.161536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b4a6a-c858-4270-9618-5b276202c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:39.162208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b4a6a-c858-4270-9618-5b276202c7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:39.162503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b4a6a-c858-4270-9618-5b276202c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:39.162787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b4a6a-c858-4270-9618-5b276202c7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:39.163525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b4a6a-c858-4270-9618-5b276202c7c8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:39.163830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b4a6a-c858-4270-9618-5b276202c7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:39.189219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b4a6a-c858-4270-9618-5b276202c7c8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:39.199493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 37/72] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:19:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:39.206779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ca26b-004a-4d9c-bdf8-1f1f3b4b4706 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:39.221045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ca26b-004a-4d9c-bdf8-1f1f3b4b4706 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:39.225463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc1d8c-253f-43d0-89ea-37ce1402ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:39.226319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1d8c-253f-43d0-89ea-37ce1402ac51 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:39.226608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1d8c-253f-43d0-89ea-37ce1402ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:39.226890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1d8c-253f-43d0-89ea-37ce1402ac51 admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:39.228015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc1d8c-253f-43d0-89ea-37ce1402ac51 admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:39.259141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc1d8c-253f-43d0-89ea-37ce1402ac51 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:39.260841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 36/73] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:39 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:39.268816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b4a6a-c858-4270-9618-5b276202c7c8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:39.283045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b4a6a-c858-4270-9618-5b276202c7c8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:39.288374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3e0a3-5773-417a-8bd3-805473c02222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:39.289226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3e0a3-5773-417a-8bd3-805473c02222 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:39.289551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3e0a3-5773-417a-8bd3-805473c02222 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:39.289840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3e0a3-5773-417a-8bd3-805473c02222 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:39.291087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3e0a3-5773-417a-8bd3-805473c02222 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:39.318371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3e0a3-5773-417a-8bd3-805473c02222 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:39.320137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 38/74] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:39 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:39.332449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc1d8c-253f-43d0-89ea-37ce1402ac51 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:39.342387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc1d8c-253f-43d0-89ea-37ce1402ac51 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:39.346874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03276b-930f-4399-89d7-100b1c24318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:39.348076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03276b-930f-4399-89d7-100b1c24318c admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:39.348383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03276b-930f-4399-89d7-100b1c24318c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:39.348660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03276b-930f-4399-89d7-100b1c24318c admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/users/fd2894712b85445fbc68a4343ad9d3bf/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:39.350570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03276b-930f-4399-89d7-100b1c24318c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec15c254e4e4438ba97f65c3eb214d1d, user_id=fd2894712b85445fbc68a4343ad9d3bf, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:39.377039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03276b-930f-4399-89d7-100b1c24318c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:39.393692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 37/75] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:19:39 2021] PUT /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/users/fd2894712b85445fbc68a4343ad9d3bf/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:19:41.370543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6f34-008e-47ff-b4f2-25e6c5cd9f9e None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:41.371109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6f34-008e-47ff-b4f2-25e6c5cd9f9e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:41.371109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d6f34-008e-47ff-b4f2-25e6c5cd9f9e None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:41.372859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 39/76] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:41.379809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a66dc9-9336-4bfc-b873-cbce21c11f7e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:41.380256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a66dc9-9336-4bfc-b873-cbce21c11f7e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:41.380358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a66dc9-9336-4bfc-b873-cbce21c11f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:41.414311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d8a66dc9-9336-4bfc-b873-cbce21c11f7e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:41.415396 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d8a66dc9-9336-4bfc-b873-cbce21c11f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:41.484479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 38/77] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:41.514710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d6f34-008e-47ff-b4f2-25e6c5cd9f9e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:41.528048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d6f34-008e-47ff-b4f2-25e6c5cd9f9e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:41.532771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea6d81-d6f5-4377-8d96-27a635c39ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:41.533650 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea6d81-d6f5-4377-8d96-27a635c39ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:41.533931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea6d81-d6f5-4377-8d96-27a635c39ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:41.534317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea6d81-d6f5-4377-8d96-27a635c39ad3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:41.547886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea6d81-d6f5-4377-8d96-27a635c39ad3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:41.554556 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-d4ea6d81-d6f5-4377-8d96-27a635c39ad3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:19:41.555661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 40/78] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:41.562056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a66dc9-9336-4bfc-b873-cbce21c11f7e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:41.573445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a66dc9-9336-4bfc-b873-cbce21c11f7e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:41.579071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ef09d-3641-414b-8c47-1235d7cf8913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:41.579730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ef09d-3641-414b-8c47-1235d7cf8913 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:41.579975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ef09d-3641-414b-8c47-1235d7cf8913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:41.580257 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ef09d-3641-414b-8c47-1235d7cf8913 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:41.581560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ef09d-3641-414b-8c47-1235d7cf8913 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:41.581866 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ef09d-3641-414b-8c47-1235d7cf8913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:41.607421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ef09d-3641-414b-8c47-1235d7cf8913 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:41.617220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 39/79] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:19:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:41.625489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea6d81-d6f5-4377-8d96-27a635c39ad3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:41.636200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea6d81-d6f5-4377-8d96-27a635c39ad3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:41.641065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7198d3-5112-431c-a78c-aa1e424a551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:41.641854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7198d3-5112-431c-a78c-aa1e424a551b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:41.642174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7198d3-5112-431c-a78c-aa1e424a551b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:41.642455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7198d3-5112-431c-a78c-aa1e424a551b admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:41.644365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7198d3-5112-431c-a78c-aa1e424a551b admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:41.670705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7198d3-5112-431c-a78c-aa1e424a551b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:41.672147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 41/80] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:41 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:41.680624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ef09d-3641-414b-8c47-1235d7cf8913 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:41.694692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ef09d-3641-414b-8c47-1235d7cf8913 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:41.700562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311456cd-06b0-4310-a614-1fa99620fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:41.701141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311456cd-06b0-4310-a614-1fa99620fb27 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:41.701430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311456cd-06b0-4310-a614-1fa99620fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:41.701712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311456cd-06b0-4310-a614-1fa99620fb27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:41.710222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311456cd-06b0-4310-a614-1fa99620fb27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:41.735625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311456cd-06b0-4310-a614-1fa99620fb27 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:41.744918 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 40/81] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:19:41.753708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7198d3-5112-431c-a78c-aa1e424a551b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:41.769000 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7198d3-5112-431c-a78c-aa1e424a551b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:41.774690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce392268-a72b-4e26-b817-0f567901d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:41.775494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392268-a72b-4e26-b817-0f567901d5fc admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:41.775806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392268-a72b-4e26-b817-0f567901d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:41.776085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392268-a72b-4e26-b817-0f567901d5fc admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:41.777410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce392268-a72b-4e26-b817-0f567901d5fc admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:41.803588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce392268-a72b-4e26-b817-0f567901d5fc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:41.805110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 42/82] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:41 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:41.811368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311456cd-06b0-4310-a614-1fa99620fb27 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:41.826823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311456cd-06b0-4310-a614-1fa99620fb27 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:41.833314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f75d29-edb1-4f95-b038-70b26ac8f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:41.833812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f75d29-edb1-4f95-b038-70b26ac8f853 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:41.834140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f75d29-edb1-4f95-b038-70b26ac8f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:41.834429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f75d29-edb1-4f95-b038-70b26ac8f853 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:41.835214 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f75d29-edb1-4f95-b038-70b26ac8f853 admin admin] RBAC: Adding query filter params (role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d, user.id=fd2894712b85445fbc68a4343ad9d3bf) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:41.835525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f75d29-edb1-4f95-b038-70b26ac8f853 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:41.860167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-34f75d29-edb1-4f95-b038-70b26ac8f853 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:41.860167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:19:41.860167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:19:41.861363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f75d29-edb1-4f95-b038-70b26ac8f853 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:41.868656 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 41/83] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:19:41 2021] GET /identity/v3/role_assignments?user.id=fd2894712b85445fbc68a4343ad9d3bf&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:43.908571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9236ed-3d0e-4530-be9f-eeaf479f84ba None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:43.909186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9236ed-3d0e-4530-be9f-eeaf479f84ba None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:43.909186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9236ed-3d0e-4530-be9f-eeaf479f84ba None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:43.910967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 43/84] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:43.916582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58fb34-fb98-4806-9b52-7e40eeaec558 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:43.917012 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58fb34-fb98-4806-9b52-7e40eeaec558 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:43.917108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58fb34-fb98-4806-9b52-7e40eeaec558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:43.941389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9d58fb34-fb98-4806-9b52-7e40eeaec558 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:43.942562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9d58fb34-fb98-4806-9b52-7e40eeaec558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:43.950849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 42/85] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:43.974350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9236ed-3d0e-4530-be9f-eeaf479f84ba None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:43.988484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9236ed-3d0e-4530-be9f-eeaf479f84ba None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:43.993315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34576-908c-41fb-83c0-2d62001796b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:43.994075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34576-908c-41fb-83c0-2d62001796b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:43.994367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34576-908c-41fb-83c0-2d62001796b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:43.994655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34576-908c-41fb-83c0-2d62001796b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:44.009587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb34576-908c-41fb-83c0-2d62001796b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:44.016082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-2bb34576-908c-41fb-83c0-2d62001796b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:19:44.017490 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 44/86] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:19:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:44.025461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58fb34-fb98-4806-9b52-7e40eeaec558 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:44.037108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58fb34-fb98-4806-9b52-7e40eeaec558 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:44.042585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167b0c9-5422-456e-b5c4-3fa329b6f78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:44.043191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167b0c9-5422-456e-b5c4-3fa329b6f78b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:44.043477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167b0c9-5422-456e-b5c4-3fa329b6f78b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:44.043757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167b0c9-5422-456e-b5c4-3fa329b6f78b admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:44.044483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167b0c9-5422-456e-b5c4-3fa329b6f78b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:44.044788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167b0c9-5422-456e-b5c4-3fa329b6f78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:44.070606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167b0c9-5422-456e-b5c4-3fa329b6f78b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:44.080781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 43/87] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:44.086841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34576-908c-41fb-83c0-2d62001796b0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:44.097138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34576-908c-41fb-83c0-2d62001796b0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:44.102019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097bd84-cca4-46ee-9ea6-1bfba8a1d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:44.102843 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097bd84-cca4-46ee-9ea6-1bfba8a1d36f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:44.103127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097bd84-cca4-46ee-9ea6-1bfba8a1d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:44.103402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097bd84-cca4-46ee-9ea6-1bfba8a1d36f admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:44.104652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097bd84-cca4-46ee-9ea6-1bfba8a1d36f admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:44.130256 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097bd84-cca4-46ee-9ea6-1bfba8a1d36f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:44.131812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 45/88] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:44 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:44.137696 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167b0c9-5422-456e-b5c4-3fa329b6f78b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:44.147698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167b0c9-5422-456e-b5c4-3fa329b6f78b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:44.152328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d0644-a919-45c9-a272-9a3f023a4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:44.152916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d0644-a919-45c9-a272-9a3f023a4660 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:44.153199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d0644-a919-45c9-a272-9a3f023a4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:44.153478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d0644-a919-45c9-a272-9a3f023a4660 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:44.161891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d0644-a919-45c9-a272-9a3f023a4660 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:44.187033 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d0644-a919-45c9-a272-9a3f023a4660 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:44.196978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 44/89] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:19:44.203332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097bd84-cca4-46ee-9ea6-1bfba8a1d36f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:44.213946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097bd84-cca4-46ee-9ea6-1bfba8a1d36f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:44.219257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35a550-e772-46b0-996a-ff36f9c620c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:44.220530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a550-e772-46b0-996a-ff36f9c620c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:44.220826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a550-e772-46b0-996a-ff36f9c620c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:44.221114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a550-e772-46b0-996a-ff36f9c620c4 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:44.222353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35a550-e772-46b0-996a-ff36f9c620c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:44.251519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35a550-e772-46b0-996a-ff36f9c620c4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:44.253617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 46/90] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:44 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:44.259740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d0644-a919-45c9-a272-9a3f023a4660 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:44.269412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d0644-a919-45c9-a272-9a3f023a4660 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:44.273831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d97589-bb0d-4a7d-8237-6b56085a99f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:44.274449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97589-bb0d-4a7d-8237-6b56085a99f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:44.274737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97589-bb0d-4a7d-8237-6b56085a99f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:44.275024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97589-bb0d-4a7d-8237-6b56085a99f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:44.275802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d97589-bb0d-4a7d-8237-6b56085a99f4 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d, user.id=69b3dce5d565425ca928deea4c6b8503) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:44.276111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d97589-bb0d-4a7d-8237-6b56085a99f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:44.302082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d97589-bb0d-4a7d-8237-6b56085a99f4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:44.308220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 45/91] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:19:44 2021] GET /identity/v3/role_assignments?user.id=69b3dce5d565425ca928deea4c6b8503&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:19:46.404571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17a571-d9bb-469b-935a-c7b627c96927 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:46.405104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17a571-d9bb-469b-935a-c7b627c96927 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:46.405104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17a571-d9bb-469b-935a-c7b627c96927 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:46.407959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 47/92] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:46.414158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11497ea9-33e6-4523-b22b-ee6b30905dc2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:46.414588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11497ea9-33e6-4523-b22b-ee6b30905dc2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:46.414737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11497ea9-33e6-4523-b22b-ee6b30905dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:46.438397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-11497ea9-33e6-4523-b22b-ee6b30905dc2 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:46.439570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-11497ea9-33e6-4523-b22b-ee6b30905dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:46.446553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 46/93] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:46.470392 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17a571-d9bb-469b-935a-c7b627c96927 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:46.483730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17a571-d9bb-469b-935a-c7b627c96927 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:46.488592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13d39b-60a1-4c41-bd59-8fa3b8ba80ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:46.489381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13d39b-60a1-4c41-bd59-8fa3b8ba80ef admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:46.489677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13d39b-60a1-4c41-bd59-8fa3b8ba80ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:46.489954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13d39b-60a1-4c41-bd59-8fa3b8ba80ef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:46.502544 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13d39b-60a1-4c41-bd59-8fa3b8ba80ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:46.509063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-ee13d39b-60a1-4c41-bd59-8fa3b8ba80ef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:19:46.510268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 48/94] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:19:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:46.516977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11497ea9-33e6-4523-b22b-ee6b30905dc2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:46.525876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11497ea9-33e6-4523-b22b-ee6b30905dc2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:46.530294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3462b-9100-4bcb-9c0a-4f5cb31ce8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:46.530892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3462b-9100-4bcb-9c0a-4f5cb31ce8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:46.531180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3462b-9100-4bcb-9c0a-4f5cb31ce8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:46.531672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3462b-9100-4bcb-9c0a-4f5cb31ce8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:46.532785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3462b-9100-4bcb-9c0a-4f5cb31ce8a9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:46.533092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3462b-9100-4bcb-9c0a-4f5cb31ce8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:46.559403 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3462b-9100-4bcb-9c0a-4f5cb31ce8a9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:46.570017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 47/95] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:46.575739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13d39b-60a1-4c41-bd59-8fa3b8ba80ef admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:46.586661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13d39b-60a1-4c41-bd59-8fa3b8ba80ef admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:46.590968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edeeb2b-e7f3-4e57-af31-fb34983eeb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:46.591793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeeb2b-e7f3-4e57-af31-fb34983eeb15 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:46.592075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeeb2b-e7f3-4e57-af31-fb34983eeb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:46.592354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeeb2b-e7f3-4e57-af31-fb34983eeb15 admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:46.593483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edeeb2b-e7f3-4e57-af31-fb34983eeb15 admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:46.620124 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edeeb2b-e7f3-4e57-af31-fb34983eeb15 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:46.621701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 49/96] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:46 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:46.627969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3462b-9100-4bcb-9c0a-4f5cb31ce8a9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:46.642153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3462b-9100-4bcb-9c0a-4f5cb31ce8a9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:46.650489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f91e59-3506-46f9-8db2-82658cfadff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:46.651746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f91e59-3506-46f9-8db2-82658cfadff8 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:46.652213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f91e59-3506-46f9-8db2-82658cfadff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:46.652734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f91e59-3506-46f9-8db2-82658cfadff8 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:46.655077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f91e59-3506-46f9-8db2-82658cfadff8 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:46.681965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f91e59-3506-46f9-8db2-82658cfadff8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:46.683713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 48/97] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:46 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:19:46.692784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edeeb2b-e7f3-4e57-af31-fb34983eeb15 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:46.710593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edeeb2b-e7f3-4e57-af31-fb34983eeb15 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:46.718795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90a1bc-5587-454d-aa6b-0900e28fca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:46.719871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90a1bc-5587-454d-aa6b-0900e28fca21 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:46.720207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90a1bc-5587-454d-aa6b-0900e28fca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:46.720529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90a1bc-5587-454d-aa6b-0900e28fca21 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/users/69b3dce5d565425ca928deea4c6b8503/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:46.722853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90a1bc-5587-454d-aa6b-0900e28fca21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec15c254e4e4438ba97f65c3eb214d1d, user_id=69b3dce5d565425ca928deea4c6b8503, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:46.751766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-aa90a1bc-5587-454d-aa6b-0900e28fca21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:19:46.751766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:19:46.751766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:19:46.754080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90a1bc-5587-454d-aa6b-0900e28fca21 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:46.770690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 50/98] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:19:46 2021] PUT /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/users/69b3dce5d565425ca928deea4c6b8503/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:19:48.903355 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c0f2b-7595-4d29-96a0-ff0ef6cbba8e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:48.903992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c0f2b-7595-4d29-96a0-ff0ef6cbba8e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:48.904381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c0f2b-7595-4d29-96a0-ff0ef6cbba8e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:48.906858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 49/99] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:48.912651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce38c-b472-4961-9fca-8823532600b4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:48.913080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce38c-b472-4961-9fca-8823532600b4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:48.913227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce38c-b472-4961-9fca-8823532600b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:48.938929 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-69bce38c-b472-4961-9fca-8823532600b4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:48.940209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-69bce38c-b472-4961-9fca-8823532600b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:49.014162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 51/100] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:49.041959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c0f2b-7595-4d29-96a0-ff0ef6cbba8e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:49.060144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c0f2b-7595-4d29-96a0-ff0ef6cbba8e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:49.066427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38442125-14de-43c7-94cd-81d228822893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:49.067161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38442125-14de-43c7-94cd-81d228822893 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:49.067453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38442125-14de-43c7-94cd-81d228822893 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:49.067725 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38442125-14de-43c7-94cd-81d228822893 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:49.081181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38442125-14de-43c7-94cd-81d228822893 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:49.087784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-38442125-14de-43c7-94cd-81d228822893 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:19:49.088956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 50/101] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:19:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:49.095549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce38c-b472-4961-9fca-8823532600b4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:49.107609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce38c-b472-4961-9fca-8823532600b4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:49.113129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aa31a-14fb-4af3-a6cf-d76e99b6cd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:49.113730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aa31a-14fb-4af3-a6cf-d76e99b6cd89 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:49.114027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aa31a-14fb-4af3-a6cf-d76e99b6cd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:49.114320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aa31a-14fb-4af3-a6cf-d76e99b6cd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:49.115036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811aa31a-14fb-4af3-a6cf-d76e99b6cd89 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:49.115303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811aa31a-14fb-4af3-a6cf-d76e99b6cd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:49.142778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811aa31a-14fb-4af3-a6cf-d76e99b6cd89 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:49.153079 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 52/102] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:49.159552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38442125-14de-43c7-94cd-81d228822893 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:49.170141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38442125-14de-43c7-94cd-81d228822893 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:49.176688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c522ee-23b8-4103-9d9a-648293921624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:49.177847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c522ee-23b8-4103-9d9a-648293921624 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:49.178284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c522ee-23b8-4103-9d9a-648293921624 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:49.178645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c522ee-23b8-4103-9d9a-648293921624 admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:49.180359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c522ee-23b8-4103-9d9a-648293921624 admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:49.208489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c522ee-23b8-4103-9d9a-648293921624 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:49.210142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 51/103] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:49 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:49.217424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aa31a-14fb-4af3-a6cf-d76e99b6cd89 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:49.232170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aa31a-14fb-4af3-a6cf-d76e99b6cd89 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:49.237603 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5eea-a5c1-43f9-9162-ff1b83a3e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:49.238407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5eea-a5c1-43f9-9162-ff1b83a3e559 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:49.238710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5eea-a5c1-43f9-9162-ff1b83a3e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:49.239088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5eea-a5c1-43f9-9162-ff1b83a3e559 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:49.249747 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f5eea-a5c1-43f9-9162-ff1b83a3e559 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:49.275916 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f5eea-a5c1-43f9-9162-ff1b83a3e559 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:49.285479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 53/104] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:19:49.292226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c522ee-23b8-4103-9d9a-648293921624 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:49.302423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c522ee-23b8-4103-9d9a-648293921624 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:49.308584 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5031a-4514-49c4-bc08-a0edc386f72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:49.309692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5031a-4514-49c4-bc08-a0edc386f72e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:49.310555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5031a-4514-49c4-bc08-a0edc386f72e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:49.310933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5031a-4514-49c4-bc08-a0edc386f72e admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:49.312695 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5031a-4514-49c4-bc08-a0edc386f72e admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:49.342228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5031a-4514-49c4-bc08-a0edc386f72e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:49.344446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 52/105] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:49 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:49.351045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5eea-a5c1-43f9-9162-ff1b83a3e559 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:49.360891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5eea-a5c1-43f9-9162-ff1b83a3e559 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:49.365524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff1f12-1f05-41fb-932d-f2fc4163a682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:49.366180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1f12-1f05-41fb-932d-f2fc4163a682 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:49.366478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1f12-1f05-41fb-932d-f2fc4163a682 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:49.366843 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1f12-1f05-41fb-932d-f2fc4163a682 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:49.367648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff1f12-1f05-41fb-932d-f2fc4163a682 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d, user.id=69b3dce5d565425ca928deea4c6b8503) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:49.367957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff1f12-1f05-41fb-932d-f2fc4163a682 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:49.395463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff1f12-1f05-41fb-932d-f2fc4163a682 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:49.402540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 54/106] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:19:49 2021] GET /identity/v3/role_assignments?user.id=69b3dce5d565425ca928deea4c6b8503&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:51.545290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe23cbd-25f9-4903-a68f-f1add51a8267 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:51.545827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe23cbd-25f9-4903-a68f-f1add51a8267 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:51.546170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe23cbd-25f9-4903-a68f-f1add51a8267 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:51.548140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 53/107] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:51.556825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4573f-b70c-4c87-8c92-7f6844695001 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:51.557806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4573f-b70c-4c87-8c92-7f6844695001 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:51.557806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4573f-b70c-4c87-8c92-7f6844695001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:51.582848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-28a4573f-b70c-4c87-8c92-7f6844695001 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:51.584005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-28a4573f-b70c-4c87-8c92-7f6844695001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:51.591317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 55/108] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:19:51.614677 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe23cbd-25f9-4903-a68f-f1add51a8267 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:51.627388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe23cbd-25f9-4903-a68f-f1add51a8267 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:51.631651 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a64fe-8984-4065-91d4-120e8e6bbca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:51.632401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a64fe-8984-4065-91d4-120e8e6bbca4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:51.632692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a64fe-8984-4065-91d4-120e8e6bbca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:51.632974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a64fe-8984-4065-91d4-120e8e6bbca4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:51.646026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a64fe-8984-4065-91d4-120e8e6bbca4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:51.652961 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-3f9a64fe-8984-4065-91d4-120e8e6bbca4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:19:51.654143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 54/109] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:19:51 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:51.660341 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4573f-b70c-4c87-8c92-7f6844695001 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:51.669582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4573f-b70c-4c87-8c92-7f6844695001 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:51.674996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98d1a6-ebba-4c72-b45b-58e1df0e927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:51.675597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98d1a6-ebba-4c72-b45b-58e1df0e927b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:51.675879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98d1a6-ebba-4c72-b45b-58e1df0e927b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:51.676163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98d1a6-ebba-4c72-b45b-58e1df0e927b admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:51.676886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98d1a6-ebba-4c72-b45b-58e1df0e927b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:51.677186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98d1a6-ebba-4c72-b45b-58e1df0e927b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:51.703181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98d1a6-ebba-4c72-b45b-58e1df0e927b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:51.712815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 56/110] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:19:51 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:51.718909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a64fe-8984-4065-91d4-120e8e6bbca4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:51.729890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a64fe-8984-4065-91d4-120e8e6bbca4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:51.735455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb39a5f-06f4-4723-a91d-0fa5d08426f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:51.736290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb39a5f-06f4-4723-a91d-0fa5d08426f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:51.736573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb39a5f-06f4-4723-a91d-0fa5d08426f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:51.736863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb39a5f-06f4-4723-a91d-0fa5d08426f0 admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:51.738163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb39a5f-06f4-4723-a91d-0fa5d08426f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:51.768604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb39a5f-06f4-4723-a91d-0fa5d08426f0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:51.770257 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 55/111] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:51 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:51.776724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98d1a6-ebba-4c72-b45b-58e1df0e927b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:51.789022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98d1a6-ebba-4c72-b45b-58e1df0e927b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:51.794234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571d34f-f11b-4a28-971a-d34603530779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:51.794919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571d34f-f11b-4a28-971a-d34603530779 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:51.795287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571d34f-f11b-4a28-971a-d34603530779 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:51.795890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571d34f-f11b-4a28-971a-d34603530779 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:51.805130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571d34f-f11b-4a28-971a-d34603530779 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:51.832852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571d34f-f11b-4a28-971a-d34603530779 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:51.842960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 57/112] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:19:51.848916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb39a5f-06f4-4723-a91d-0fa5d08426f0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:51.858984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb39a5f-06f4-4723-a91d-0fa5d08426f0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:51.863884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbed16-0b36-4b50-9d53-db36f0f4c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:51.864701 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbed16-0b36-4b50-9d53-db36f0f4c913 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:51.864986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbed16-0b36-4b50-9d53-db36f0f4c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:51.865318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbed16-0b36-4b50-9d53-db36f0f4c913 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:51.866541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbed16-0b36-4b50-9d53-db36f0f4c913 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:51.892940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbed16-0b36-4b50-9d53-db36f0f4c913 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:51.894581 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 56/113] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:51 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:51.901540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571d34f-f11b-4a28-971a-d34603530779 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:51.911457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571d34f-f11b-4a28-971a-d34603530779 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:51.917244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeacb68-8b4d-4db3-b32a-f98b388685c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:51.917835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacb68-8b4d-4db3-b32a-f98b388685c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:51.918167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacb68-8b4d-4db3-b32a-f98b388685c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:51.918451 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacb68-8b4d-4db3-b32a-f98b388685c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:51.919257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacb68-8b4d-4db3-b32a-f98b388685c8 admin admin] RBAC: Adding query filter params (role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d, user.id=fd2894712b85445fbc68a4343ad9d3bf) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:51.919562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacb68-8b4d-4db3-b32a-f98b388685c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:51.949942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacb68-8b4d-4db3-b32a-f98b388685c8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:51.956728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 58/114] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:19:51 2021] GET /identity/v3/role_assignments?user.id=fd2894712b85445fbc68a4343ad9d3bf&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:53.994573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0d4da-d24f-4827-abdc-d6584c6a8f27 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:53.995446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0d4da-d24f-4827-abdc-d6584c6a8f27 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:53.995446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0d4da-d24f-4827-abdc-d6584c6a8f27 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:53.997490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 57/115] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:54.003340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460012-c6e2-4998-b6ce-e4ce34caf02b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:54.003797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460012-c6e2-4998-b6ce-e4ce34caf02b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:54.003921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460012-c6e2-4998-b6ce-e4ce34caf02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:54.038417 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d3460012-c6e2-4998-b6ce-e4ce34caf02b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:54.039923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d3460012-c6e2-4998-b6ce-e4ce34caf02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:54.049526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 59/116] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:54.076645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0d4da-d24f-4827-abdc-d6584c6a8f27 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:54.092126 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0d4da-d24f-4827-abdc-d6584c6a8f27 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:54.096291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d5b2-cc0d-45a5-b645-c176547d625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:54.097044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d5b2-cc0d-45a5-b645-c176547d625f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:54.097334 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d5b2-cc0d-45a5-b645-c176547d625f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:54.097617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d5b2-cc0d-45a5-b645-c176547d625f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:54.109607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488d5b2-cc0d-45a5-b645-c176547d625f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:54.116447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-5488d5b2-cc0d-45a5-b645-c176547d625f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:19:54.117580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 58/117] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:19:54 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:54.123808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3460012-c6e2-4998-b6ce-e4ce34caf02b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:54.132674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3460012-c6e2-4998-b6ce-e4ce34caf02b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:54.137250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8ad00-30f7-4067-b55c-892723ff5adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:54.137894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8ad00-30f7-4067-b55c-892723ff5adb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:54.138671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8ad00-30f7-4067-b55c-892723ff5adb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:54.138671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8ad00-30f7-4067-b55c-892723ff5adb admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:54.139330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8ad00-30f7-4067-b55c-892723ff5adb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:54.139688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8ad00-30f7-4067-b55c-892723ff5adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:54.165826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8ad00-30f7-4067-b55c-892723ff5adb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:54.175462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 60/118] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:19:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:54.181364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d5b2-cc0d-45a5-b645-c176547d625f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:54.192313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d5b2-cc0d-45a5-b645-c176547d625f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:54.196843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fc531-189c-44e3-be0a-ce71ea8ea1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:54.197744 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fc531-189c-44e3-be0a-ce71ea8ea1ad admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:54.198040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fc531-189c-44e3-be0a-ce71ea8ea1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:54.198333 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fc531-189c-44e3-be0a-ce71ea8ea1ad admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:54.199460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fc531-189c-44e3-be0a-ce71ea8ea1ad admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:54.226410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fc531-189c-44e3-be0a-ce71ea8ea1ad admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:54.227999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 59/119] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:54 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:54.233954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8ad00-30f7-4067-b55c-892723ff5adb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:54.245514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8ad00-30f7-4067-b55c-892723ff5adb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:54.250582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a85f8-1873-49cd-a1e0-3124a58cd73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:54.251619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a85f8-1873-49cd-a1e0-3124a58cd73b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:54.251908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a85f8-1873-49cd-a1e0-3124a58cd73b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:54.252420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a85f8-1873-49cd-a1e0-3124a58cd73b admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:54.253667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a85f8-1873-49cd-a1e0-3124a58cd73b admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:54.280812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a85f8-1873-49cd-a1e0-3124a58cd73b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:54.282474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 61/120] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:54 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:54.288527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fc531-189c-44e3-be0a-ce71ea8ea1ad admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:54.299064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fc531-189c-44e3-be0a-ce71ea8ea1ad admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:54.304175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db05ce6-268b-46a7-804d-c8ac9b54aac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:54.305039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db05ce6-268b-46a7-804d-c8ac9b54aac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:54.305320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db05ce6-268b-46a7-804d-c8ac9b54aac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:54.305598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db05ce6-268b-46a7-804d-c8ac9b54aac8 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/users/fd2894712b85445fbc68a4343ad9d3bf/roles/066e315d3c6b43edbbe4609b54fc3a2a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:54.308019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db05ce6-268b-46a7-804d-c8ac9b54aac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec15c254e4e4438ba97f65c3eb214d1d, user_id=fd2894712b85445fbc68a4343ad9d3bf, role_id=066e315d3c6b43edbbe4609b54fc3a2a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:54.334497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db05ce6-268b-46a7-804d-c8ac9b54aac8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:54.350153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 60/121] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:19:54 2021] PUT /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/users/fd2894712b85445fbc68a4343ad9d3bf/roles/066e315d3c6b43edbbe4609b54fc3a2a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:19:56.318152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3538ec-e524-420b-92eb-5c25b2e535b7 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:56.318702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3538ec-e524-420b-92eb-5c25b2e535b7 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:56.318702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3538ec-e524-420b-92eb-5c25b2e535b7 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:56.320391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 62/122] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:56.325844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a66d9-7168-4a20-bc64-abc98755eff2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:56.326327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a66d9-7168-4a20-bc64-abc98755eff2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:56.326431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a66d9-7168-4a20-bc64-abc98755eff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:56.350443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3b9a66d9-7168-4a20-bc64-abc98755eff2 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:56.351608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3b9a66d9-7168-4a20-bc64-abc98755eff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:56.419398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 61/123] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:56.441967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3538ec-e524-420b-92eb-5c25b2e535b7 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:56.455470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3538ec-e524-420b-92eb-5c25b2e535b7 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:56.460199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947a57-66c8-4878-9dfe-75f44b2c8856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:56.460919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947a57-66c8-4878-9dfe-75f44b2c8856 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:56.461226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947a57-66c8-4878-9dfe-75f44b2c8856 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:56.461507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947a57-66c8-4878-9dfe-75f44b2c8856 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:56.474201 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06947a57-66c8-4878-9dfe-75f44b2c8856 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:56.481132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-06947a57-66c8-4878-9dfe-75f44b2c8856 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:19:56.482219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 63/124] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:19:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:56.488123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a66d9-7168-4a20-bc64-abc98755eff2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:56.497234 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a66d9-7168-4a20-bc64-abc98755eff2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:56.502490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79db42-d06a-43d4-9d42-8861481a20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:56.503094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79db42-d06a-43d4-9d42-8861481a20fd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:56.503384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79db42-d06a-43d4-9d42-8861481a20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:56.503666 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79db42-d06a-43d4-9d42-8861481a20fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:56.504387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79db42-d06a-43d4-9d42-8861481a20fd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:56.504692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79db42-d06a-43d4-9d42-8861481a20fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:56.530024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79db42-d06a-43d4-9d42-8861481a20fd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:56.539369 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 62/125] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:19:56 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:56.545429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947a57-66c8-4878-9dfe-75f44b2c8856 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:56.554887 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947a57-66c8-4878-9dfe-75f44b2c8856 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:56.559679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02911e-730b-4269-b405-3606bfa58c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:56.560475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02911e-730b-4269-b405-3606bfa58c4d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:56.560763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02911e-730b-4269-b405-3606bfa58c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:56.561039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02911e-730b-4269-b405-3606bfa58c4d admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:56.562187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02911e-730b-4269-b405-3606bfa58c4d admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:56.588056 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02911e-730b-4269-b405-3606bfa58c4d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:56.589505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 64/126] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:56 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:56.594931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79db42-d06a-43d4-9d42-8861481a20fd admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:56.604414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79db42-d06a-43d4-9d42-8861481a20fd admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:56.609648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbd1a2-9c6e-4277-b78c-12b0150b67cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:56.610266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbd1a2-9c6e-4277-b78c-12b0150b67cb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:56.610556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbd1a2-9c6e-4277-b78c-12b0150b67cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:56.610837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbd1a2-9c6e-4277-b78c-12b0150b67cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:56.618747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbd1a2-9c6e-4277-b78c-12b0150b67cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:56.644195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbd1a2-9c6e-4277-b78c-12b0150b67cb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:56.653103 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 63/127] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:19:56.658577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02911e-730b-4269-b405-3606bfa58c4d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:56.668078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02911e-730b-4269-b405-3606bfa58c4d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:56.672618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a75337-483c-4d87-baf0-092f47a0bdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:56.673342 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75337-483c-4d87-baf0-092f47a0bdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:56.673634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75337-483c-4d87-baf0-092f47a0bdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:56.673918 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75337-483c-4d87-baf0-092f47a0bdd7 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:56.675087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75337-483c-4d87-baf0-092f47a0bdd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:56.701121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75337-483c-4d87-baf0-092f47a0bdd7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:56.702860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 65/128] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:56 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:56.708659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbd1a2-9c6e-4277-b78c-12b0150b67cb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:56.717693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbd1a2-9c6e-4277-b78c-12b0150b67cb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:56.723006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66466332-fbd6-4571-b715-7fe606d02858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:56.723589 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66466332-fbd6-4571-b715-7fe606d02858 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:56.723871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66466332-fbd6-4571-b715-7fe606d02858 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:56.724151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66466332-fbd6-4571-b715-7fe606d02858 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:56.724926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66466332-fbd6-4571-b715-7fe606d02858 admin admin] RBAC: Adding query filter params (role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d, user.id=fd2894712b85445fbc68a4343ad9d3bf) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:56.725228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66466332-fbd6-4571-b715-7fe606d02858 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:56.757773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66466332-fbd6-4571-b715-7fe606d02858 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:56.764580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 64/129] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:19:56 2021] GET /identity/v3/role_assignments?user.id=fd2894712b85445fbc68a4343ad9d3bf&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:58.778716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ebd76-5025-4723-a9ac-1a8fd5e405f8 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:58.779240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ebd76-5025-4723-a9ac-1a8fd5e405f8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:58.779323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ebd76-5025-4723-a9ac-1a8fd5e405f8 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:58.781060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 66/130] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:19:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:19:58.786611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16194b03-0280-4bbc-a41f-7933f1cda067 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:58.786992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16194b03-0280-4bbc-a41f-7933f1cda067 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:58.787213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16194b03-0280-4bbc-a41f-7933f1cda067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:58.812162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-16194b03-0280-4bbc-a41f-7933f1cda067 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:19:58.813324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-16194b03-0280-4bbc-a41f-7933f1cda067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:19:58.820546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 65/131] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:19:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:19:58.843425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ebd76-5025-4723-a9ac-1a8fd5e405f8 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:58.855868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ebd76-5025-4723-a9ac-1a8fd5e405f8 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:58.860317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a8927-7b1b-4252-bc14-e2122f3fdc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:58.861042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a8927-7b1b-4252-bc14-e2122f3fdc6c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:58.861337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a8927-7b1b-4252-bc14-e2122f3fdc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:58.861616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a8927-7b1b-4252-bc14-e2122f3fdc6c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:58.873488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a8927-7b1b-4252-bc14-e2122f3fdc6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:19:58.880006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-6b5a8927-7b1b-4252-bc14-e2122f3fdc6c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:19:58.881085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 67/132] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:19:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:19:58.886939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16194b03-0280-4bbc-a41f-7933f1cda067 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:58.896115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16194b03-0280-4bbc-a41f-7933f1cda067 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:58.900985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cac581-f632-4db1-b034-aa587f13c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:58.901617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cac581-f632-4db1-b034-aa587f13c7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:58.902197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cac581-f632-4db1-b034-aa587f13c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:58.902508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cac581-f632-4db1-b034-aa587f13c7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:58.903254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cac581-f632-4db1-b034-aa587f13c7c5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:58.903560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cac581-f632-4db1-b034-aa587f13c7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:58.928837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cac581-f632-4db1-b034-aa587f13c7c5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:58.938350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 66/133] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:19:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:58.944225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a8927-7b1b-4252-bc14-e2122f3fdc6c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:58.955306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a8927-7b1b-4252-bc14-e2122f3fdc6c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:58.960037 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2090-cfae-4213-92a1-8a1dec32a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:58.960851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2090-cfae-4213-92a1-8a1dec32a1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:58.961141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2090-cfae-4213-92a1-8a1dec32a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:58.961422 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2090-cfae-4213-92a1-8a1dec32a1e3 admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:58.962693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2090-cfae-4213-92a1-8a1dec32a1e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:58.988709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2090-cfae-4213-92a1-8a1dec32a1e3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:58.990636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 68/134] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:19:58 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:58.996569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cac581-f632-4db1-b034-aa587f13c7c5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:59.011200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cac581-f632-4db1-b034-aa587f13c7c5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:59.015654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ba3c1-9aae-4c6e-ab20-72d781d41319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:59.016242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ba3c1-9aae-4c6e-ab20-72d781d41319 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:59.016525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ba3c1-9aae-4c6e-ab20-72d781d41319 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:59.016802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ba3c1-9aae-4c6e-ab20-72d781d41319 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:59.024760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ba3c1-9aae-4c6e-ab20-72d781d41319 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:59.050413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ba3c1-9aae-4c6e-ab20-72d781d41319 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:59.059478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 67/135] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:19:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:19:59.065261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2090-cfae-4213-92a1-8a1dec32a1e3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:59.074828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2090-cfae-4213-92a1-8a1dec32a1e3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:59.079222 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd7bd8-4fdc-481d-a8bc-3df685d54268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:59.080064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7bd8-4fdc-481d-a8bc-3df685d54268 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:59.080356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7bd8-4fdc-481d-a8bc-3df685d54268 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:59.080627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7bd8-4fdc-481d-a8bc-3df685d54268 admin admin] PATH_INFO: `/v3/projects/0156957cb88e41a2a33d5a862c550bad` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:59.081767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd7bd8-4fdc-481d-a8bc-3df685d54268 admin admin] RBAC: Authorizing `identity:get_project(project_id=0156957cb88e41a2a33d5a862c550bad)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:59.108053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd7bd8-4fdc-481d-a8bc-3df685d54268 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:59.109710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 69/136] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:19:59 2021] GET /identity/v3/projects/0156957cb88e41a2a33d5a862c550bad => generated 312 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:19:59.115791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ba3c1-9aae-4c6e-ab20-72d781d41319 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:19:59.125426 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ba3c1-9aae-4c6e-ab20-72d781d41319 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:19:59.129795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd90cbe-cd0f-4aa6-91b7-36b6e40dbbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:19:59.130418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90cbe-cd0f-4aa6-91b7-36b6e40dbbdc admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:19:59.130682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90cbe-cd0f-4aa6-91b7-36b6e40dbbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:19:59.130989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90cbe-cd0f-4aa6-91b7-36b6e40dbbdc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:19:59.131773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd90cbe-cd0f-4aa6-91b7-36b6e40dbbdc admin admin] RBAC: Adding query filter params (role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=0156957cb88e41a2a33d5a862c550bad, user.id=fd2894712b85445fbc68a4343ad9d3bf) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:19:59.132103 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd90cbe-cd0f-4aa6-91b7-36b6e40dbbdc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:19:59.161896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd90cbe-cd0f-4aa6-91b7-36b6e40dbbdc admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:19:59.168600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 68/137] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:19:59 2021] GET /identity/v3/role_assignments?user.id=fd2894712b85445fbc68a4343ad9d3bf&scope.project.id=0156957cb88e41a2a33d5a862c550bad&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:01.156301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ae717-4e8b-48d9-9bc9-dcce84961614 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:01.156823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ae717-4e8b-48d9-9bc9-dcce84961614 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:01.156929 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ae717-4e8b-48d9-9bc9-dcce84961614 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:01.158580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 70/138] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:01.164312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa432cc2-4558-46dc-a5c2-93a54f1e83a3 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:01.164765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa432cc2-4558-46dc-a5c2-93a54f1e83a3 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:01.164890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa432cc2-4558-46dc-a5c2-93a54f1e83a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:01.188720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-aa432cc2-4558-46dc-a5c2-93a54f1e83a3 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:01.189883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-aa432cc2-4558-46dc-a5c2-93a54f1e83a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:01.196979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 69/139] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:20:01.219469 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ae717-4e8b-48d9-9bc9-dcce84961614 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:01.233147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ae717-4e8b-48d9-9bc9-dcce84961614 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:01.237736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6585f02-87a6-4cc2-91bc-150d5c5fbd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:01.238524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6585f02-87a6-4cc2-91bc-150d5c5fbd04 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:01.238805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6585f02-87a6-4cc2-91bc-150d5c5fbd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:01.239087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6585f02-87a6-4cc2-91bc-150d5c5fbd04 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:01.251200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6585f02-87a6-4cc2-91bc-150d5c5fbd04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:01.257686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-e6585f02-87a6-4cc2-91bc-150d5c5fbd04 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:01.258853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 71/140] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:01.266200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa432cc2-4558-46dc-a5c2-93a54f1e83a3 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:01.276040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa432cc2-4558-46dc-a5c2-93a54f1e83a3 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:01.281254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08bc7a-0652-4953-b312-0578d2795052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:01.281968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08bc7a-0652-4953-b312-0578d2795052 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:01.282298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08bc7a-0652-4953-b312-0578d2795052 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:01.282617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08bc7a-0652-4953-b312-0578d2795052 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:01.283446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08bc7a-0652-4953-b312-0578d2795052 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:01.283837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08bc7a-0652-4953-b312-0578d2795052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:01.311692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08bc7a-0652-4953-b312-0578d2795052 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:01.322467 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 70/141] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:01.329076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6585f02-87a6-4cc2-91bc-150d5c5fbd04 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:01.341054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6585f02-87a6-4cc2-91bc-150d5c5fbd04 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:01.346199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a48ad-c4dd-497a-84ff-d47a1c9814fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:01.347068 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a48ad-c4dd-497a-84ff-d47a1c9814fd admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:01.347358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a48ad-c4dd-497a-84ff-d47a1c9814fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:01.347644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a48ad-c4dd-497a-84ff-d47a1c9814fd admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:01.349015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a48ad-c4dd-497a-84ff-d47a1c9814fd admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:01.375258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a48ad-c4dd-497a-84ff-d47a1c9814fd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:01.376864 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 72/142] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:01 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:01.382804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08bc7a-0652-4953-b312-0578d2795052 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:01.393233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08bc7a-0652-4953-b312-0578d2795052 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:01.399403 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e41ace-26fb-425a-8088-74aa11ecaa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:01.400266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e41ace-26fb-425a-8088-74aa11ecaa23 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:01.400547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e41ace-26fb-425a-8088-74aa11ecaa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:01.400824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e41ace-26fb-425a-8088-74aa11ecaa23 admin admin] PATH_INFO: `/v3/projects/0156957cb88e41a2a33d5a862c550bad` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:01.402049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e41ace-26fb-425a-8088-74aa11ecaa23 admin admin] RBAC: Authorizing `identity:get_project(project_id=0156957cb88e41a2a33d5a862c550bad)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:01.427684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e41ace-26fb-425a-8088-74aa11ecaa23 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:01.429253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 71/143] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:01 2021] GET /identity/v3/projects/0156957cb88e41a2a33d5a862c550bad => generated 312 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:01.435717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a48ad-c4dd-497a-84ff-d47a1c9814fd admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:01.445573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a48ad-c4dd-497a-84ff-d47a1c9814fd admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:01.450671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0e595-2ec4-45a4-ac71-eaad1d381429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:01.451501 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0e595-2ec4-45a4-ac71-eaad1d381429 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:01.451787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0e595-2ec4-45a4-ac71-eaad1d381429 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:01.452066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0e595-2ec4-45a4-ac71-eaad1d381429 admin admin] PATH_INFO: `/v3/projects/0156957cb88e41a2a33d5a862c550bad/users/fd2894712b85445fbc68a4343ad9d3bf/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:01.453825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0e595-2ec4-45a4-ac71-eaad1d381429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0156957cb88e41a2a33d5a862c550bad, user_id=fd2894712b85445fbc68a4343ad9d3bf, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:01.487634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0e595-2ec4-45a4-ac71-eaad1d381429 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:01.503685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 73/144] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:20:01 2021] PUT /identity/v3/projects/0156957cb88e41a2a33d5a862c550bad/users/fd2894712b85445fbc68a4343ad9d3bf/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:20:03.497867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59447272-0534-438d-9fa2-f8f095da878e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:03.498444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59447272-0534-438d-9fa2-f8f095da878e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:03.498444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59447272-0534-438d-9fa2-f8f095da878e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:03.500184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 72/145] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:03.506380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d0455-1635-4318-afe9-42dc32f90c34 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:03.507005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d0455-1635-4318-afe9-42dc32f90c34 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:03.507005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d0455-1635-4318-afe9-42dc32f90c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:03.536380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-825d0455-1635-4318-afe9-42dc32f90c34 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:03.537582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-825d0455-1635-4318-afe9-42dc32f90c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:03.611031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 74/146] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:03.633793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59447272-0534-438d-9fa2-f8f095da878e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:03.647576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59447272-0534-438d-9fa2-f8f095da878e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:03.652557 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb43532-94e0-419a-87ea-122389b2ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:03.653313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb43532-94e0-419a-87ea-122389b2ebfb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:03.653599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb43532-94e0-419a-87ea-122389b2ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:03.653884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb43532-94e0-419a-87ea-122389b2ebfb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:03.666569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb43532-94e0-419a-87ea-122389b2ebfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:03.673102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-1bb43532-94e0-419a-87ea-122389b2ebfb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:03.674269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 73/147] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:03.680947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d0455-1635-4318-afe9-42dc32f90c34 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:03.690566 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d0455-1635-4318-afe9-42dc32f90c34 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:03.695818 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aca32-bffc-4d51-8bf1-89e28d705a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:03.696393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aca32-bffc-4d51-8bf1-89e28d705a71 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:03.696677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aca32-bffc-4d51-8bf1-89e28d705a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:03.696958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aca32-bffc-4d51-8bf1-89e28d705a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:03.698187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aca32-bffc-4d51-8bf1-89e28d705a71 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:03.698665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aca32-bffc-4d51-8bf1-89e28d705a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:03.725087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aca32-bffc-4d51-8bf1-89e28d705a71 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:03.735305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 75/148] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:03.741416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb43532-94e0-419a-87ea-122389b2ebfb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:03.751592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb43532-94e0-419a-87ea-122389b2ebfb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:03.756749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db7d9-9e97-48dd-8f6b-03fa80014c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:03.757578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db7d9-9e97-48dd-8f6b-03fa80014c7e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:03.757861 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db7d9-9e97-48dd-8f6b-03fa80014c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:03.758173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db7d9-9e97-48dd-8f6b-03fa80014c7e admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:03.759408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46db7d9-9e97-48dd-8f6b-03fa80014c7e admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:03.785418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46db7d9-9e97-48dd-8f6b-03fa80014c7e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:03.786976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 74/149] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:03 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:03.792811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aca32-bffc-4d51-8bf1-89e28d705a71 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:03.802997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aca32-bffc-4d51-8bf1-89e28d705a71 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:03.808418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df865e43-e54f-4c15-b7da-536c25f673b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:03.808990 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865e43-e54f-4c15-b7da-536c25f673b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:03.809276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865e43-e54f-4c15-b7da-536c25f673b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:03.809551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865e43-e54f-4c15-b7da-536c25f673b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:03.817629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df865e43-e54f-4c15-b7da-536c25f673b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:03.843838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df865e43-e54f-4c15-b7da-536c25f673b0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:03.852996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 76/150] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:03.858830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db7d9-9e97-48dd-8f6b-03fa80014c7e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:03.869055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db7d9-9e97-48dd-8f6b-03fa80014c7e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:03.874665 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef5f76-39de-4d51-ba9f-eb272fc11e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:03.875466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef5f76-39de-4d51-ba9f-eb272fc11e77 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:03.875754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef5f76-39de-4d51-ba9f-eb272fc11e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:03.876042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef5f76-39de-4d51-ba9f-eb272fc11e77 admin admin] PATH_INFO: `/v3/projects/0156957cb88e41a2a33d5a862c550bad` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:03.877252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef5f76-39de-4d51-ba9f-eb272fc11e77 admin admin] RBAC: Authorizing `identity:get_project(project_id=0156957cb88e41a2a33d5a862c550bad)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:03.905391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef5f76-39de-4d51-ba9f-eb272fc11e77 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:03.907064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 75/151] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:03 2021] GET /identity/v3/projects/0156957cb88e41a2a33d5a862c550bad => generated 312 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:03.915096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df865e43-e54f-4c15-b7da-536c25f673b0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:03.924713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df865e43-e54f-4c15-b7da-536c25f673b0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:03.930515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8cb74-9b51-4672-8876-c08a3d505b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:03.931131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8cb74-9b51-4672-8876-c08a3d505b30 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:03.931681 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8cb74-9b51-4672-8876-c08a3d505b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:03.932051 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8cb74-9b51-4672-8876-c08a3d505b30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:03.932897 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8cb74-9b51-4672-8876-c08a3d505b30 admin admin] RBAC: Adding query filter params (role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=0156957cb88e41a2a33d5a862c550bad, user.id=fd2894712b85445fbc68a4343ad9d3bf) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:03.933206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8cb74-9b51-4672-8876-c08a3d505b30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:03.958734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8cb74-9b51-4672-8876-c08a3d505b30 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:03.965614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 77/152] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:20:03 2021] GET /identity/v3/role_assignments?user.id=fd2894712b85445fbc68a4343ad9d3bf&scope.project.id=0156957cb88e41a2a33d5a862c550bad&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:06.133724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf48ad0-5b04-4534-82fa-45765daefae9 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:06.134371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf48ad0-5b04-4534-82fa-45765daefae9 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:06.134371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf48ad0-5b04-4534-82fa-45765daefae9 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:06.136185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 76/153] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:06.141765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3d85-7ce3-468e-8420-5c3874e90dea None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:06.142271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3d85-7ce3-468e-8420-5c3874e90dea None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:06.142377 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3d85-7ce3-468e-8420-5c3874e90dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:06.166229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-720f3d85-7ce3-468e-8420-5c3874e90dea None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:06.167413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-720f3d85-7ce3-468e-8420-5c3874e90dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:06.175611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 78/154] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:06.199851 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf48ad0-5b04-4534-82fa-45765daefae9 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:06.216008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf48ad0-5b04-4534-82fa-45765daefae9 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:06.220311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad5b70-00bd-4593-a762-8ad2b1e55638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:06.221047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad5b70-00bd-4593-a762-8ad2b1e55638 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:06.221328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad5b70-00bd-4593-a762-8ad2b1e55638 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:06.221607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad5b70-00bd-4593-a762-8ad2b1e55638 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:06.222743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad5b70-00bd-4593-a762-8ad2b1e55638 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:06.248092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad5b70-00bd-4593-a762-8ad2b1e55638 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:06.249678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 77/155] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:20:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:06.255634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f3d85-7ce3-468e-8420-5c3874e90dea None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:06.264868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f3d85-7ce3-468e-8420-5c3874e90dea None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:06.270140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfa7f1-c1be-4d8f-a1a7-230f8c618b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:06.270745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa7f1-c1be-4d8f-a1a7-230f8c618b68 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:06.271035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa7f1-c1be-4d8f-a1a7-230f8c618b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:06.271315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa7f1-c1be-4d8f-a1a7-230f8c618b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:06.271998 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfa7f1-c1be-4d8f-a1a7-230f8c618b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:06.297798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfa7f1-c1be-4d8f-a1a7-230f8c618b68 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:06.327510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 79/156] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:20:06 2021] POST /identity/v3/projects => generated 302 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:20:08.354256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bbb3-2775-45c8-82f6-1f8d07925020 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:08.354799 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bbb3-2775-45c8-82f6-1f8d07925020 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:08.354890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bbb3-2775-45c8-82f6-1f8d07925020 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:08.356600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 78/157] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:08.362400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7910ed2-36cd-40d8-9653-0f25a4399fd2 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:08.362919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7910ed2-36cd-40d8-9653-0f25a4399fd2 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:08.363004 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7910ed2-36cd-40d8-9653-0f25a4399fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:08.385476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a7910ed2-36cd-40d8-9653-0f25a4399fd2 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:08.386729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a7910ed2-36cd-40d8-9653-0f25a4399fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:08.456949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 80/158] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:08.480947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bbb3-2775-45c8-82f6-1f8d07925020 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:08.495012 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bbb3-2775-45c8-82f6-1f8d07925020 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:08.500051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25e2ba-9cde-441e-a2d6-9fc380979210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:08.500809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e2ba-9cde-441e-a2d6-9fc380979210 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:08.501093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e2ba-9cde-441e-a2d6-9fc380979210 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:08.501374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e2ba-9cde-441e-a2d6-9fc380979210 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:08.502699 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25e2ba-9cde-441e-a2d6-9fc380979210 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:08.528865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25e2ba-9cde-441e-a2d6-9fc380979210 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:08.530595 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 79/159] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:20:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:08.536725 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7910ed2-36cd-40d8-9653-0f25a4399fd2 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:08.546493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7910ed2-36cd-40d8-9653-0f25a4399fd2 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:08.551968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273606e-fee5-48c2-808c-46b8203c5c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:08.552598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273606e-fee5-48c2-808c-46b8203c5c65 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:08.552883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273606e-fee5-48c2-808c-46b8203c5c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:08.553159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273606e-fee5-48c2-808c-46b8203c5c65 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:08.553833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273606e-fee5-48c2-808c-46b8203c5c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:08.580880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273606e-fee5-48c2-808c-46b8203c5c65 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:08.605167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 81/160] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:20:08 2021] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:20:10.627628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35037877-5eb9-46f1-bd4c-7d4faf4a1b3f None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:10.628233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35037877-5eb9-46f1-bd4c-7d4faf4a1b3f None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:10.628233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35037877-5eb9-46f1-bd4c-7d4faf4a1b3f None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:10.629902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 80/161] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:10.635821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7f7f2-41a9-4507-b30d-6210401da565 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:10.636276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7f7f2-41a9-4507-b30d-6210401da565 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:10.636370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7f7f2-41a9-4507-b30d-6210401da565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:10.659951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0ca7f7f2-41a9-4507-b30d-6210401da565 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:10.661107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0ca7f7f2-41a9-4507-b30d-6210401da565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:10.669588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 82/162] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:10.692622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35037877-5eb9-46f1-bd4c-7d4faf4a1b3f None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:10.705760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35037877-5eb9-46f1-bd4c-7d4faf4a1b3f None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:10.710338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb99eb3-b5dd-4cb5-b029-6b2d9d5874b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:10.711167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb99eb3-b5dd-4cb5-b029-6b2d9d5874b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:10.712095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb99eb3-b5dd-4cb5-b029-6b2d9d5874b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:10.712399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb99eb3-b5dd-4cb5-b029-6b2d9d5874b7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:10.726650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb99eb3-b5dd-4cb5-b029-6b2d9d5874b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:10.734180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-fdb99eb3-b5dd-4cb5-b029-6b2d9d5874b7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:10.735398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 81/163] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:10.741581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7f7f2-41a9-4507-b30d-6210401da565 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:10.751003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7f7f2-41a9-4507-b30d-6210401da565 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:10.756254 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f50bd-731e-46a8-a7d3-a7b06aa2815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:10.756850 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f50bd-731e-46a8-a7d3-a7b06aa2815b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:10.757138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f50bd-731e-46a8-a7d3-a7b06aa2815b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:10.757415 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f50bd-731e-46a8-a7d3-a7b06aa2815b admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:10.758202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f50bd-731e-46a8-a7d3-a7b06aa2815b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:10.758746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f50bd-731e-46a8-a7d3-a7b06aa2815b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:10.784032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f50bd-731e-46a8-a7d3-a7b06aa2815b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:10.793946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 83/164] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:10.800288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb99eb3-b5dd-4cb5-b029-6b2d9d5874b7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:10.812085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb99eb3-b5dd-4cb5-b029-6b2d9d5874b7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:10.817371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ccc1e-b1a4-44a8-b040-7e76c2136c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:10.818222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ccc1e-b1a4-44a8-b040-7e76c2136c8b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:10.818502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ccc1e-b1a4-44a8-b040-7e76c2136c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:10.818780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ccc1e-b1a4-44a8-b040-7e76c2136c8b admin admin] PATH_INFO: `/v3/users/8c0b42a164964ff296253cb2e8ee9e93` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:10.838420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ccc1e-b1a4-44a8-b040-7e76c2136c8b admin admin] RBAC: Authorizing `identity:get_user(user_id=8c0b42a164964ff296253cb2e8ee9e93)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:10.864209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ccc1e-b1a4-44a8-b040-7e76c2136c8b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:10.865799 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 82/165] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:10 2021] GET /identity/v3/users/8c0b42a164964ff296253cb2e8ee9e93 => generated 283 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:10.871720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f50bd-731e-46a8-a7d3-a7b06aa2815b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:10.881802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f50bd-731e-46a8-a7d3-a7b06aa2815b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:10.886767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3fdf-2cde-48ae-b8f7-5f2f23d00675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:10.887348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3fdf-2cde-48ae-b8f7-5f2f23d00675 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:10.887635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3fdf-2cde-48ae-b8f7-5f2f23d00675 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:10.887915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3fdf-2cde-48ae-b8f7-5f2f23d00675 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:10.895921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3fdf-2cde-48ae-b8f7-5f2f23d00675 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:10.921503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3fdf-2cde-48ae-b8f7-5f2f23d00675 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:10.931574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 84/166] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:10.937643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ccc1e-b1a4-44a8-b040-7e76c2136c8b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:10.948682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ccc1e-b1a4-44a8-b040-7e76c2136c8b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:10.954539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6ab9d-c373-413f-811d-86de8a875717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:10.955346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6ab9d-c373-413f-811d-86de8a875717 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:10.955628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6ab9d-c373-413f-811d-86de8a875717 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:10.955901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6ab9d-c373-413f-811d-86de8a875717 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:10.957085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6ab9d-c373-413f-811d-86de8a875717 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:10.982988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6ab9d-c373-413f-811d-86de8a875717 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:10.984622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 83/167] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:10 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:10.990801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3fdf-2cde-48ae-b8f7-5f2f23d00675 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:10.999916 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3fdf-2cde-48ae-b8f7-5f2f23d00675 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:11.005267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f9f9a-7df2-4c71-9b56-6c18e8ae962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:11.005875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f9f9a-7df2-4c71-9b56-6c18e8ae962c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:11.006197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f9f9a-7df2-4c71-9b56-6c18e8ae962c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:11.006478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f9f9a-7df2-4c71-9b56-6c18e8ae962c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:11.007330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f9f9a-7df2-4c71-9b56-6c18e8ae962c admin admin] RBAC: Adding query filter params (role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc, user.id=8c0b42a164964ff296253cb2e8ee9e93) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:11.007666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f9f9a-7df2-4c71-9b56-6c18e8ae962c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:11.033360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f9f9a-7df2-4c71-9b56-6c18e8ae962c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:11.040234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 85/168] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:20:10 2021] GET /identity/v3/role_assignments?user.id=8c0b42a164964ff296253cb2e8ee9e93&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:20:12.990231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec020d2-d8d3-4d81-95f2-f3bc54c2dced None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:12.990863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec020d2-d8d3-4d81-95f2-f3bc54c2dced None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:12.990863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec020d2-d8d3-4d81-95f2-f3bc54c2dced None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:12.992818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 84/169] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:12.998284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcce30-6393-4029-88b6-835304946f25 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:12.998728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcce30-6393-4029-88b6-835304946f25 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:12.998848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcce30-6393-4029-88b6-835304946f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:13.022572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-27bcce30-6393-4029-88b6-835304946f25 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:13.024117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-27bcce30-6393-4029-88b6-835304946f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:13.032516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 86/170] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:13.055110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec020d2-d8d3-4d81-95f2-f3bc54c2dced None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:13.068851 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec020d2-d8d3-4d81-95f2-f3bc54c2dced None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:13.073615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bdea9-98f6-4684-a48a-60e7a5e5fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:13.074454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bdea9-98f6-4684-a48a-60e7a5e5fe0f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:13.074747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bdea9-98f6-4684-a48a-60e7a5e5fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:13.075048 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bdea9-98f6-4684-a48a-60e7a5e5fe0f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:13.086818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bdea9-98f6-4684-a48a-60e7a5e5fe0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:13.093328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-e95bdea9-98f6-4684-a48a-60e7a5e5fe0f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:13.094480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 85/171] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:13.100404 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcce30-6393-4029-88b6-835304946f25 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:13.110105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcce30-6393-4029-88b6-835304946f25 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:13.114417 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849163-f4f6-4550-955a-43a8d12655f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:13.115017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849163-f4f6-4550-955a-43a8d12655f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:13.115366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849163-f4f6-4550-955a-43a8d12655f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:13.115650 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849163-f4f6-4550-955a-43a8d12655f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:13.116405 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3849163-f4f6-4550-955a-43a8d12655f5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:13.116935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3849163-f4f6-4550-955a-43a8d12655f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:13.150333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3849163-f4f6-4550-955a-43a8d12655f5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:13.160145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 87/172] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:13.166673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bdea9-98f6-4684-a48a-60e7a5e5fe0f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:13.178753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bdea9-98f6-4684-a48a-60e7a5e5fe0f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:13.184218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e830d-821e-4df0-8128-3b1704dcd7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:13.185010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e830d-821e-4df0-8128-3b1704dcd7cb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:13.185285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e830d-821e-4df0-8128-3b1704dcd7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:13.185552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e830d-821e-4df0-8128-3b1704dcd7cb admin admin] PATH_INFO: `/v3/users/8c0b42a164964ff296253cb2e8ee9e93` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:13.186665 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e830d-821e-4df0-8128-3b1704dcd7cb admin admin] RBAC: Authorizing `identity:get_user(user_id=8c0b42a164964ff296253cb2e8ee9e93)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:13.212643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e830d-821e-4df0-8128-3b1704dcd7cb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:13.214210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 86/173] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:13 2021] GET /identity/v3/users/8c0b42a164964ff296253cb2e8ee9e93 => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:13.220074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849163-f4f6-4550-955a-43a8d12655f5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:13.231040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849163-f4f6-4550-955a-43a8d12655f5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:13.236202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fe6ef-45e0-43e3-95e3-e6f79009e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:13.236996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fe6ef-45e0-43e3-95e3-e6f79009e9fd admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:13.237276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fe6ef-45e0-43e3-95e3-e6f79009e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:13.237554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fe6ef-45e0-43e3-95e3-e6f79009e9fd admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:13.238724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fe6ef-45e0-43e3-95e3-e6f79009e9fd admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:13.265544 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fe6ef-45e0-43e3-95e3-e6f79009e9fd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:13.267175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 88/174] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:13 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:13.272969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e830d-821e-4df0-8128-3b1704dcd7cb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:13.282939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e830d-821e-4df0-8128-3b1704dcd7cb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:13.288095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e923cf-7f5f-4ec6-aad7-ae444616d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:13.289021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e923cf-7f5f-4ec6-aad7-ae444616d5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:13.289293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e923cf-7f5f-4ec6-aad7-ae444616d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:13.289571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e923cf-7f5f-4ec6-aad7-ae444616d5ab admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/users/8c0b42a164964ff296253cb2e8ee9e93/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:13.291600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e923cf-7f5f-4ec6-aad7-ae444616d5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eda9161f20442c0af550cdfbd0da7dc, user_id=8c0b42a164964ff296253cb2e8ee9e93, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:13.317973 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e923cf-7f5f-4ec6-aad7-ae444616d5ab admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:13.333289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 87/175] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:20:13 2021] PUT /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/users/8c0b42a164964ff296253cb2e8ee9e93/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:20:15.285626 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff91e5f-4760-4387-932d-ab763f09df10 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:15.286194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff91e5f-4760-4387-932d-ab763f09df10 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:15.286194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff91e5f-4760-4387-932d-ab763f09df10 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:15.287879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 89/176] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:15.293579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcca96-d343-41d3-a183-8fd015821fcb None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:15.294056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcca96-d343-41d3-a183-8fd015821fcb None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:15.294165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcca96-d343-41d3-a183-8fd015821fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:15.317761 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e2bcca96-d343-41d3-a183-8fd015821fcb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:15.318914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e2bcca96-d343-41d3-a183-8fd015821fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:15.389935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 88/177] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:15.413257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff91e5f-4760-4387-932d-ab763f09df10 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:15.426410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff91e5f-4760-4387-932d-ab763f09df10 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:15.431810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937443f7-d2b0-4716-8f8d-3ed638f5c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:15.432536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937443f7-d2b0-4716-8f8d-3ed638f5c9af admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:15.432819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937443f7-d2b0-4716-8f8d-3ed638f5c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:15.433094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937443f7-d2b0-4716-8f8d-3ed638f5c9af admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:15.445783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937443f7-d2b0-4716-8f8d-3ed638f5c9af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:15.452331 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-937443f7-d2b0-4716-8f8d-3ed638f5c9af admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:15.453452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 90/178] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:15.459886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcca96-d343-41d3-a183-8fd015821fcb None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:15.468901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcca96-d343-41d3-a183-8fd015821fcb None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:15.474078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df10bd6-2972-4c5d-9c30-3c225323b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:15.474707 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df10bd6-2972-4c5d-9c30-3c225323b7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:15.474979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df10bd6-2972-4c5d-9c30-3c225323b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:15.475251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df10bd6-2972-4c5d-9c30-3c225323b7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:15.476069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df10bd6-2972-4c5d-9c30-3c225323b7c0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:15.476362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df10bd6-2972-4c5d-9c30-3c225323b7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:15.501512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df10bd6-2972-4c5d-9c30-3c225323b7c0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:15.511045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 89/179] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:20:15.516814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937443f7-d2b0-4716-8f8d-3ed638f5c9af admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:15.526835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937443f7-d2b0-4716-8f8d-3ed638f5c9af admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:15.531460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e59c64-ef8e-4d52-ab3c-a2450acb12ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:15.532283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e59c64-ef8e-4d52-ab3c-a2450acb12ed admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:15.532568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e59c64-ef8e-4d52-ab3c-a2450acb12ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:15.532852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e59c64-ef8e-4d52-ab3c-a2450acb12ed admin admin] PATH_INFO: `/v3/users/8c0b42a164964ff296253cb2e8ee9e93` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:15.534126 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e59c64-ef8e-4d52-ab3c-a2450acb12ed admin admin] RBAC: Authorizing `identity:get_user(user_id=8c0b42a164964ff296253cb2e8ee9e93)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:15.569347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e59c64-ef8e-4d52-ab3c-a2450acb12ed admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:15.570973 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 91/180] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:15 2021] GET /identity/v3/users/8c0b42a164964ff296253cb2e8ee9e93 => generated 283 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:15.576729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df10bd6-2972-4c5d-9c30-3c225323b7c0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:15.586816 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df10bd6-2972-4c5d-9c30-3c225323b7c0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:15.591919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec1b2-b7c1-4d9e-a3b3-f8d067b6dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:15.592505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec1b2-b7c1-4d9e-a3b3-f8d067b6dfbf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:15.592784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec1b2-b7c1-4d9e-a3b3-f8d067b6dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:15.593055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec1b2-b7c1-4d9e-a3b3-f8d067b6dfbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:15.601456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ec1b2-b7c1-4d9e-a3b3-f8d067b6dfbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:15.626825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ec1b2-b7c1-4d9e-a3b3-f8d067b6dfbf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:15.636027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 90/181] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:15.642135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e59c64-ef8e-4d52-ab3c-a2450acb12ed admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:15.652180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e59c64-ef8e-4d52-ab3c-a2450acb12ed admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:15.657090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08170c68-3937-4a91-8298-60b7470cf125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:15.657892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08170c68-3937-4a91-8298-60b7470cf125 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:15.658211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08170c68-3937-4a91-8298-60b7470cf125 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:15.658484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08170c68-3937-4a91-8298-60b7470cf125 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:15.659620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08170c68-3937-4a91-8298-60b7470cf125 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:15.685693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08170c68-3937-4a91-8298-60b7470cf125 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:15.687438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 92/182] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:15 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:15.693407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec1b2-b7c1-4d9e-a3b3-f8d067b6dfbf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:15.702207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec1b2-b7c1-4d9e-a3b3-f8d067b6dfbf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:15.706136 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e543d1-5e74-452e-8681-2488427fbbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:15.706720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e543d1-5e74-452e-8681-2488427fbbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:15.707008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e543d1-5e74-452e-8681-2488427fbbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:15.707281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e543d1-5e74-452e-8681-2488427fbbe2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:15.708066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e543d1-5e74-452e-8681-2488427fbbe2 admin admin] RBAC: Adding query filter params (role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc, user.id=8c0b42a164964ff296253cb2e8ee9e93) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:15.708359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e543d1-5e74-452e-8681-2488427fbbe2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:15.735225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e543d1-5e74-452e-8681-2488427fbbe2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:15.741501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 91/183] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:20:15 2021] GET /identity/v3/role_assignments?user.id=8c0b42a164964ff296253cb2e8ee9e93&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:17.818737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758bec8-33a9-4da9-b159-adca6e205265 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:17.819279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758bec8-33a9-4da9-b159-adca6e205265 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:17.819279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758bec8-33a9-4da9-b159-adca6e205265 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:17.820984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 93/184] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:17.826162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c7bd-620e-4df6-b934-77ad15505b64 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:17.826601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c7bd-620e-4df6-b934-77ad15505b64 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:17.826690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397c7bd-620e-4df6-b934-77ad15505b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:17.849953 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9397c7bd-620e-4df6-b934-77ad15505b64 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:17.851611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9397c7bd-620e-4df6-b934-77ad15505b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:17.859274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 92/185] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:17.881955 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758bec8-33a9-4da9-b159-adca6e205265 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:17.897972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758bec8-33a9-4da9-b159-adca6e205265 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:17.901888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584ff9a-cce0-43cc-b816-d29907cd1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:17.902644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584ff9a-cce0-43cc-b816-d29907cd1896 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:17.902925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584ff9a-cce0-43cc-b816-d29907cd1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:17.903197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584ff9a-cce0-43cc-b816-d29907cd1896 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:17.915734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584ff9a-cce0-43cc-b816-d29907cd1896 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:17.922194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-7584ff9a-cce0-43cc-b816-d29907cd1896 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:20:17.923319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 94/186] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:20:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:17.929919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c7bd-620e-4df6-b934-77ad15505b64 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:17.938998 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397c7bd-620e-4df6-b934-77ad15505b64 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:17.944403 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ef8b6-abf3-4e6e-927d-c9a0e417985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:17.945000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ef8b6-abf3-4e6e-927d-c9a0e417985b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:17.945288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ef8b6-abf3-4e6e-927d-c9a0e417985b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:17.945565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ef8b6-abf3-4e6e-927d-c9a0e417985b admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:17.946314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ef8b6-abf3-4e6e-927d-c9a0e417985b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:17.946608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ef8b6-abf3-4e6e-927d-c9a0e417985b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:17.972033 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ef8b6-abf3-4e6e-927d-c9a0e417985b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:17.982211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 93/187] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:17.988386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584ff9a-cce0-43cc-b816-d29907cd1896 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:17.999949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584ff9a-cce0-43cc-b816-d29907cd1896 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:18.004852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4585-e758-444c-b6ff-ce532b596d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:18.005652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4585-e758-444c-b6ff-ce532b596d84 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:18.005932 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4585-e758-444c-b6ff-ce532b596d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:18.006363 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4585-e758-444c-b6ff-ce532b596d84 admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:18.007511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b4585-e758-444c-b6ff-ce532b596d84 admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:18.033025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b4585-e758-444c-b6ff-ce532b596d84 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:18.034557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 95/188] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:17 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:18.040592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ef8b6-abf3-4e6e-927d-c9a0e417985b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:18.050723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ef8b6-abf3-4e6e-927d-c9a0e417985b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:18.056244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0c389-81c0-42f7-9e3e-4025ddf99c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:18.056822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0c389-81c0-42f7-9e3e-4025ddf99c4a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:18.057103 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0c389-81c0-42f7-9e3e-4025ddf99c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:18.057381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0c389-81c0-42f7-9e3e-4025ddf99c4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:18.066313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0c389-81c0-42f7-9e3e-4025ddf99c4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:18.092313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0c389-81c0-42f7-9e3e-4025ddf99c4a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:18.102354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 94/189] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:18.108112 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4585-e758-444c-b6ff-ce532b596d84 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:18.118722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4585-e758-444c-b6ff-ce532b596d84 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:18.122953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cb2ae-089e-4588-b45b-c535444d4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:18.123771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb2ae-089e-4588-b45b-c535444d4a61 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:18.124059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb2ae-089e-4588-b45b-c535444d4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:18.124339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb2ae-089e-4588-b45b-c535444d4a61 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:18.125438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cb2ae-089e-4588-b45b-c535444d4a61 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:18.151841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cb2ae-089e-4588-b45b-c535444d4a61 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:18.153543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 96/190] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:18 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:18.159930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0c389-81c0-42f7-9e3e-4025ddf99c4a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:18.169434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0c389-81c0-42f7-9e3e-4025ddf99c4a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:18.173828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf99fa9-a8e7-4ef8-bf63-4f09797cd9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:18.174530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf99fa9-a8e7-4ef8-bf63-4f09797cd9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:18.174817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf99fa9-a8e7-4ef8-bf63-4f09797cd9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:18.175091 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf99fa9-a8e7-4ef8-bf63-4f09797cd9d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:18.175889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf99fa9-a8e7-4ef8-bf63-4f09797cd9d9 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc, user.id=69b3dce5d565425ca928deea4c6b8503) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:18.176193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf99fa9-a8e7-4ef8-bf63-4f09797cd9d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:18.206715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf99fa9-a8e7-4ef8-bf63-4f09797cd9d9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:18.213587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 95/191] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:20:18 2021] GET /identity/v3/role_assignments?user.id=69b3dce5d565425ca928deea4c6b8503&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:20.180834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38130fc-2726-4803-b68b-51261293c3de None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:20.181350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38130fc-2726-4803-b68b-51261293c3de None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:20.181435 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38130fc-2726-4803-b68b-51261293c3de None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:20.183107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 97/192] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:20.188733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d60b5-8316-466d-a47b-d70d139f66c8 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:20.189166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d60b5-8316-466d-a47b-d70d139f66c8 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:20.189275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d60b5-8316-466d-a47b-d70d139f66c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:20.214332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-637d60b5-8316-466d-a47b-d70d139f66c8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:20.215457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-637d60b5-8316-466d-a47b-d70d139f66c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:20.223591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 96/193] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:20.245562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38130fc-2726-4803-b68b-51261293c3de None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:20.259241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38130fc-2726-4803-b68b-51261293c3de None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:20.264025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c78a3-392a-4bbd-9998-d575a8b54399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:20.264750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c78a3-392a-4bbd-9998-d575a8b54399 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:20.265038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c78a3-392a-4bbd-9998-d575a8b54399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:20.265321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c78a3-392a-4bbd-9998-d575a8b54399 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:20.277764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c78a3-392a-4bbd-9998-d575a8b54399 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:20.284242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-863c78a3-392a-4bbd-9998-d575a8b54399 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:20:20.285370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 98/194] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:20:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:20.291714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d60b5-8316-466d-a47b-d70d139f66c8 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:20.300986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d60b5-8316-466d-a47b-d70d139f66c8 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:20.305840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11488aa-ed5e-4ae2-ae1d-25445fa5bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:20.306500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11488aa-ed5e-4ae2-ae1d-25445fa5bec9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:20.306787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11488aa-ed5e-4ae2-ae1d-25445fa5bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:20.307069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11488aa-ed5e-4ae2-ae1d-25445fa5bec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:20.307803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11488aa-ed5e-4ae2-ae1d-25445fa5bec9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:20.308111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11488aa-ed5e-4ae2-ae1d-25445fa5bec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:20.333428 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11488aa-ed5e-4ae2-ae1d-25445fa5bec9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:20.342944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 97/195] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:20.348883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c78a3-392a-4bbd-9998-d575a8b54399 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:20.360107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c78a3-392a-4bbd-9998-d575a8b54399 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:20.364969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29807-bd65-4178-b170-2c4e34036e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:20.365971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29807-bd65-4178-b170-2c4e34036e5f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:20.366291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29807-bd65-4178-b170-2c4e34036e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:20.366569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29807-bd65-4178-b170-2c4e34036e5f admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:20.367817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29807-bd65-4178-b170-2c4e34036e5f admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:20.393370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29807-bd65-4178-b170-2c4e34036e5f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:20.394882 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 99/196] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:20 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:20.400701 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11488aa-ed5e-4ae2-ae1d-25445fa5bec9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:20.410781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11488aa-ed5e-4ae2-ae1d-25445fa5bec9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:20.415614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7d962-ce0e-4cac-86e6-c3a129dc657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:20.416413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d962-ce0e-4cac-86e6-c3a129dc657a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:20.416696 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d962-ce0e-4cac-86e6-c3a129dc657a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:20.416974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d962-ce0e-4cac-86e6-c3a129dc657a admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:20.418175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7d962-ce0e-4cac-86e6-c3a129dc657a admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:20.444497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7d962-ce0e-4cac-86e6-c3a129dc657a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:20.446217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 98/197] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:20 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:20.452242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29807-bd65-4178-b170-2c4e34036e5f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:20.462666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29807-bd65-4178-b170-2c4e34036e5f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:20.467871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b39859-e3cf-422b-b3cc-330b9ddcb568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:20.468693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b39859-e3cf-422b-b3cc-330b9ddcb568 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:20.468972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b39859-e3cf-422b-b3cc-330b9ddcb568 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:20.469250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b39859-e3cf-422b-b3cc-330b9ddcb568 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/users/69b3dce5d565425ca928deea4c6b8503/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:20.471385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b39859-e3cf-422b-b3cc-330b9ddcb568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eda9161f20442c0af550cdfbd0da7dc, user_id=69b3dce5d565425ca928deea4c6b8503, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:20.497826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b39859-e3cf-422b-b3cc-330b9ddcb568 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:20.514518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 100/198] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:20:20 2021] PUT /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/users/69b3dce5d565425ca928deea4c6b8503/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:20:22.476165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b151ab-40d8-4852-b93f-561cf123e0aa None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:22.476692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b151ab-40d8-4852-b93f-561cf123e0aa None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:22.476692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b151ab-40d8-4852-b93f-561cf123e0aa None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:22.478351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 99/199] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:20:22.483630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f031c-2851-418b-9895-54325c13cab7 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:22.484055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f031c-2851-418b-9895-54325c13cab7 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:22.484142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f031c-2851-418b-9895-54325c13cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:22.507908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c12f031c-2851-418b-9895-54325c13cab7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:22.509066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c12f031c-2851-418b-9895-54325c13cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:22.584482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 101/200] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:22.607282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b151ab-40d8-4852-b93f-561cf123e0aa None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:22.620489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b151ab-40d8-4852-b93f-561cf123e0aa None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:22.624792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9fae1-0221-4a65-85b7-f91e07d97539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:22.625572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9fae1-0221-4a65-85b7-f91e07d97539 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:22.625853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9fae1-0221-4a65-85b7-f91e07d97539 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:22.626166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9fae1-0221-4a65-85b7-f91e07d97539 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:22.638965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9fae1-0221-4a65-85b7-f91e07d97539 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:22.645440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-92c9fae1-0221-4a65-85b7-f91e07d97539 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:20:22.646874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 100/201] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:20:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:22.653038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f031c-2851-418b-9895-54325c13cab7 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:22.662518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f031c-2851-418b-9895-54325c13cab7 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:22.667707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5650-3807-4941-b082-31efd80f4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:22.668320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5650-3807-4941-b082-31efd80f4aee admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:22.668602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5650-3807-4941-b082-31efd80f4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:22.668871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5650-3807-4941-b082-31efd80f4aee admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:22.669596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5650-3807-4941-b082-31efd80f4aee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:22.669894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5650-3807-4941-b082-31efd80f4aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:22.696390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5650-3807-4941-b082-31efd80f4aee admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:22.705728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 102/202] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:22.712078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9fae1-0221-4a65-85b7-f91e07d97539 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:22.721634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9fae1-0221-4a65-85b7-f91e07d97539 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:22.726408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe80cf-a2ce-4e1a-88ad-97ade59f0fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:22.727149 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe80cf-a2ce-4e1a-88ad-97ade59f0fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:22.727430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe80cf-a2ce-4e1a-88ad-97ade59f0fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:22.727708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe80cf-a2ce-4e1a-88ad-97ade59f0fb6 admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:22.728786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe80cf-a2ce-4e1a-88ad-97ade59f0fb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:22.754500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe80cf-a2ce-4e1a-88ad-97ade59f0fb6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:22.756408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 101/203] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:22 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:22.762356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5650-3807-4941-b082-31efd80f4aee admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:22.772678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5650-3807-4941-b082-31efd80f4aee admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:22.777890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9a7bd-9f63-4033-843f-6235e4d7d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:22.778482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9a7bd-9f63-4033-843f-6235e4d7d979 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:22.778761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9a7bd-9f63-4033-843f-6235e4d7d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:22.779032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9a7bd-9f63-4033-843f-6235e4d7d979 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:22.787560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9a7bd-9f63-4033-843f-6235e4d7d979 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:22.813254 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9a7bd-9f63-4033-843f-6235e4d7d979 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:22.822307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 103/204] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:22.828494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe80cf-a2ce-4e1a-88ad-97ade59f0fb6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:22.838815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe80cf-a2ce-4e1a-88ad-97ade59f0fb6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:22.843959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a553ce9-0950-4d32-9cc9-07f6c1ba88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:22.844785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a553ce9-0950-4d32-9cc9-07f6c1ba88a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:22.845059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a553ce9-0950-4d32-9cc9-07f6c1ba88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:22.845335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a553ce9-0950-4d32-9cc9-07f6c1ba88a6 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:22.846562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a553ce9-0950-4d32-9cc9-07f6c1ba88a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:22.872453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a553ce9-0950-4d32-9cc9-07f6c1ba88a6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:22.874163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 102/205] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:22 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:22.881588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9a7bd-9f63-4033-843f-6235e4d7d979 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:22.895660 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9a7bd-9f63-4033-843f-6235e4d7d979 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:22.901207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634ff43-e961-466e-b430-c1cd4139e3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:22.901790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634ff43-e961-466e-b430-c1cd4139e3eb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:22.902199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634ff43-e961-466e-b430-c1cd4139e3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:22.902481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634ff43-e961-466e-b430-c1cd4139e3eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:22.903268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634ff43-e961-466e-b430-c1cd4139e3eb admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc, user.id=69b3dce5d565425ca928deea4c6b8503) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:22.903569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634ff43-e961-466e-b430-c1cd4139e3eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:22.935656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634ff43-e961-466e-b430-c1cd4139e3eb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:22.942570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 104/206] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:20:22 2021] GET /identity/v3/role_assignments?user.id=69b3dce5d565425ca928deea4c6b8503&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 608 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:24.949047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6b5d-50eb-4ee4-86b9-0b010feacf20 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:24.949622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6b5d-50eb-4ee4-86b9-0b010feacf20 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:24.949622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6b5d-50eb-4ee4-86b9-0b010feacf20 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:24.951381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 103/207] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:24.956923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5c81d-8587-49a7-a1be-9d5c95cf0e50 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:24.957357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5c81d-8587-49a7-a1be-9d5c95cf0e50 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:24.957440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5c81d-8587-49a7-a1be-9d5c95cf0e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:24.982885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-93a5c81d-8587-49a7-a1be-9d5c95cf0e50 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:24.984035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-93a5c81d-8587-49a7-a1be-9d5c95cf0e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:24.992108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 105/208] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:25.014920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6b5d-50eb-4ee4-86b9-0b010feacf20 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:25.027379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6b5d-50eb-4ee4-86b9-0b010feacf20 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:25.031635 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eca1de-ad2e-4e76-8033-76532fba846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:25.032372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eca1de-ad2e-4e76-8033-76532fba846f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:25.032655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eca1de-ad2e-4e76-8033-76532fba846f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:25.032935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eca1de-ad2e-4e76-8033-76532fba846f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:25.045109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eca1de-ad2e-4e76-8033-76532fba846f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:25.052424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-d8eca1de-ad2e-4e76-8033-76532fba846f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:20:25.053568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 104/209] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:20:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:25.060629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5c81d-8587-49a7-a1be-9d5c95cf0e50 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:25.070480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5c81d-8587-49a7-a1be-9d5c95cf0e50 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:25.075351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a333-3a84-4c99-8c3b-70a13dc983cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:25.075988 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a333-3a84-4c99-8c3b-70a13dc983cb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:25.076319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a333-3a84-4c99-8c3b-70a13dc983cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:25.076591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a333-3a84-4c99-8c3b-70a13dc983cb admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:25.077343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a333-3a84-4c99-8c3b-70a13dc983cb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:25.077645 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a333-3a84-4c99-8c3b-70a13dc983cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:25.102917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a333-3a84-4c99-8c3b-70a13dc983cb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:25.112197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 106/210] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:20:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:25.118388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eca1de-ad2e-4e76-8033-76532fba846f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:25.131274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eca1de-ad2e-4e76-8033-76532fba846f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:25.135404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60822cd5-4ee4-4d53-9583-7fff44a7430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:25.136255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60822cd5-4ee4-4d53-9583-7fff44a7430c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:25.136581 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60822cd5-4ee4-4d53-9583-7fff44a7430c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:25.136859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60822cd5-4ee4-4d53-9583-7fff44a7430c admin admin] PATH_INFO: `/v3/users/8c0b42a164964ff296253cb2e8ee9e93` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:25.138019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60822cd5-4ee4-4d53-9583-7fff44a7430c admin admin] RBAC: Authorizing `identity:get_user(user_id=8c0b42a164964ff296253cb2e8ee9e93)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:25.163926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60822cd5-4ee4-4d53-9583-7fff44a7430c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:25.165466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 105/211] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:25 2021] GET /identity/v3/users/8c0b42a164964ff296253cb2e8ee9e93 => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:25.171775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a333-3a84-4c99-8c3b-70a13dc983cb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:25.182766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a333-3a84-4c99-8c3b-70a13dc983cb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:25.188663 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558660b7-8425-4a46-b6a1-1a672962153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:25.189244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558660b7-8425-4a46-b6a1-1a672962153f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:25.189524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558660b7-8425-4a46-b6a1-1a672962153f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:25.189803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558660b7-8425-4a46-b6a1-1a672962153f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:25.198794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558660b7-8425-4a46-b6a1-1a672962153f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:25.234499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558660b7-8425-4a46-b6a1-1a672962153f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:25.244130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 107/212] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:25.250348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60822cd5-4ee4-4d53-9583-7fff44a7430c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:25.261812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60822cd5-4ee4-4d53-9583-7fff44a7430c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:25.267819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c759b8e-06c7-45b8-9991-987be13feae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:25.268995 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c759b8e-06c7-45b8-9991-987be13feae1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:25.272987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c759b8e-06c7-45b8-9991-987be13feae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:25.274381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c759b8e-06c7-45b8-9991-987be13feae1 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:25.275653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c759b8e-06c7-45b8-9991-987be13feae1 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:25.301719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c759b8e-06c7-45b8-9991-987be13feae1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:25.303368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 106/213] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:25 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:25.309545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558660b7-8425-4a46-b6a1-1a672962153f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:25.318942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558660b7-8425-4a46-b6a1-1a672962153f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:25.323276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995a3ef-d5a8-4f1f-8c0f-40899eb862b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:25.323861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995a3ef-d5a8-4f1f-8c0f-40899eb862b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:25.324146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995a3ef-d5a8-4f1f-8c0f-40899eb862b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:25.324430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995a3ef-d5a8-4f1f-8c0f-40899eb862b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:25.325212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995a3ef-d5a8-4f1f-8c0f-40899eb862b9 admin admin] RBAC: Adding query filter params (role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc, user.id=8c0b42a164964ff296253cb2e8ee9e93) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:25.325514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995a3ef-d5a8-4f1f-8c0f-40899eb862b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:25.351950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995a3ef-d5a8-4f1f-8c0f-40899eb862b9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:25.358693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 108/214] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:20:25 2021] GET /identity/v3/role_assignments?user.id=8c0b42a164964ff296253cb2e8ee9e93&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:27.362128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e731ed-2996-49a9-a18b-7d071fb7f94a None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:27.362646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e731ed-2996-49a9-a18b-7d071fb7f94a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:27.362729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e731ed-2996-49a9-a18b-7d071fb7f94a None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:27.365078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 107/215] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:27.370605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e6e70-0886-4e0e-bf2f-7055f302c79c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:27.371060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e6e70-0886-4e0e-bf2f-7055f302c79c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:27.371163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e6e70-0886-4e0e-bf2f-7055f302c79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:27.394565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-de3e6e70-0886-4e0e-bf2f-7055f302c79c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:27.395708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-de3e6e70-0886-4e0e-bf2f-7055f302c79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:27.403387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 109/216] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:20:27.425246 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e731ed-2996-49a9-a18b-7d071fb7f94a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:27.437327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e731ed-2996-49a9-a18b-7d071fb7f94a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:27.441574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc35d2-947e-4e11-92e0-0b88ed93bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:27.442452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc35d2-947e-4e11-92e0-0b88ed93bb4d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:27.442732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc35d2-947e-4e11-92e0-0b88ed93bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:27.443006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc35d2-947e-4e11-92e0-0b88ed93bb4d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:27.454847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc35d2-947e-4e11-92e0-0b88ed93bb4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:27.461711 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-7cbc35d2-947e-4e11-92e0-0b88ed93bb4d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:20:27.462870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 108/217] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:20:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:27.469001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e6e70-0886-4e0e-bf2f-7055f302c79c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:27.478262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e6e70-0886-4e0e-bf2f-7055f302c79c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:27.482690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f40af6-daa5-41fd-a129-3f3bd4b80859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:27.483278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f40af6-daa5-41fd-a129-3f3bd4b80859 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:27.483558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f40af6-daa5-41fd-a129-3f3bd4b80859 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:27.483831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f40af6-daa5-41fd-a129-3f3bd4b80859 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:27.484561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f40af6-daa5-41fd-a129-3f3bd4b80859 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:27.484852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f40af6-daa5-41fd-a129-3f3bd4b80859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:27.511355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f40af6-daa5-41fd-a129-3f3bd4b80859 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:27.520903 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 110/218] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:20:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:27.527406 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc35d2-947e-4e11-92e0-0b88ed93bb4d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:27.541353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc35d2-947e-4e11-92e0-0b88ed93bb4d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:27.545774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e319ff-d973-4f14-b5f3-215fe003749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:27.546673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e319ff-d973-4f14-b5f3-215fe003749c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:27.546956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e319ff-d973-4f14-b5f3-215fe003749c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:27.547235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e319ff-d973-4f14-b5f3-215fe003749c admin admin] PATH_INFO: `/v3/users/8c0b42a164964ff296253cb2e8ee9e93` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:27.548363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e319ff-d973-4f14-b5f3-215fe003749c admin admin] RBAC: Authorizing `identity:get_user(user_id=8c0b42a164964ff296253cb2e8ee9e93)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:27.574815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e319ff-d973-4f14-b5f3-215fe003749c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:27.576343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 109/219] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:27 2021] GET /identity/v3/users/8c0b42a164964ff296253cb2e8ee9e93 => generated 283 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:27.582229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f40af6-daa5-41fd-a129-3f3bd4b80859 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:27.592276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f40af6-daa5-41fd-a129-3f3bd4b80859 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:27.597496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614c0a0-52dc-4219-8b9c-fc9114580de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:27.598430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614c0a0-52dc-4219-8b9c-fc9114580de9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:27.598708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614c0a0-52dc-4219-8b9c-fc9114580de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:27.598985 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614c0a0-52dc-4219-8b9c-fc9114580de9 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:27.600207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614c0a0-52dc-4219-8b9c-fc9114580de9 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:27.626142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614c0a0-52dc-4219-8b9c-fc9114580de9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:27.627742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 111/220] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:27 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:27.633796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e319ff-d973-4f14-b5f3-215fe003749c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:27.643883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e319ff-d973-4f14-b5f3-215fe003749c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:27.649255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1cecb-c60a-4515-b6f6-8dae28afb3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:27.650082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1cecb-c60a-4515-b6f6-8dae28afb3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:27.650368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1cecb-c60a-4515-b6f6-8dae28afb3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:27.650654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1cecb-c60a-4515-b6f6-8dae28afb3cf admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/users/8c0b42a164964ff296253cb2e8ee9e93/roles/066e315d3c6b43edbbe4609b54fc3a2a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:27.653085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1cecb-c60a-4515-b6f6-8dae28afb3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eda9161f20442c0af550cdfbd0da7dc, user_id=8c0b42a164964ff296253cb2e8ee9e93, role_id=066e315d3c6b43edbbe4609b54fc3a2a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:27.680049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1cecb-c60a-4515-b6f6-8dae28afb3cf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:27.694619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 110/221] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:20:27 2021] PUT /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/users/8c0b42a164964ff296253cb2e8ee9e93/roles/066e315d3c6b43edbbe4609b54fc3a2a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:20:29.673221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca9ec-9c58-44f7-8103-bc34530e54f9 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:29.673775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca9ec-9c58-44f7-8103-bc34530e54f9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:29.673775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ca9ec-9c58-44f7-8103-bc34530e54f9 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:29.675883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 112/222] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:29.681377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ded6a-dc27-4ceb-88be-3318e3bf8730 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:29.681819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ded6a-dc27-4ceb-88be-3318e3bf8730 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:29.681931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ded6a-dc27-4ceb-88be-3318e3bf8730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:29.705632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-bf9ded6a-dc27-4ceb-88be-3318e3bf8730 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:29.706793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-bf9ded6a-dc27-4ceb-88be-3318e3bf8730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:29.775072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 111/223] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:29.798162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca9ec-9c58-44f7-8103-bc34530e54f9 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:29.812004 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ca9ec-9c58-44f7-8103-bc34530e54f9 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:29.816277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c41bf-e535-40ef-ad41-9e593f726feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:29.817331 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c41bf-e535-40ef-ad41-9e593f726feb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:29.817620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c41bf-e535-40ef-ad41-9e593f726feb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:29.817903 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c41bf-e535-40ef-ad41-9e593f726feb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:29.831222 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c41bf-e535-40ef-ad41-9e593f726feb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:29.838483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-3b6c41bf-e535-40ef-ad41-9e593f726feb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:20:29.839595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 113/224] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:20:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:29.845858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ded6a-dc27-4ceb-88be-3318e3bf8730 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:29.855150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ded6a-dc27-4ceb-88be-3318e3bf8730 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:29.860430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4384c9-02ce-4a5d-bdcf-e7ca960a4964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:29.861022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4384c9-02ce-4a5d-bdcf-e7ca960a4964 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:29.861299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4384c9-02ce-4a5d-bdcf-e7ca960a4964 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:29.861582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4384c9-02ce-4a5d-bdcf-e7ca960a4964 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:29.862322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4384c9-02ce-4a5d-bdcf-e7ca960a4964 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:29.862624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4384c9-02ce-4a5d-bdcf-e7ca960a4964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:29.889519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4384c9-02ce-4a5d-bdcf-e7ca960a4964 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:29.900008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 112/225] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:20:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:20:29.906448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c41bf-e535-40ef-ad41-9e593f726feb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:29.916805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c41bf-e535-40ef-ad41-9e593f726feb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:29.921370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9064f7-a618-4dd1-898c-01f29cd13fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:29.922250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9064f7-a618-4dd1-898c-01f29cd13fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:29.922532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9064f7-a618-4dd1-898c-01f29cd13fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:29.922804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9064f7-a618-4dd1-898c-01f29cd13fc7 admin admin] PATH_INFO: `/v3/users/8c0b42a164964ff296253cb2e8ee9e93` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:29.924030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9064f7-a618-4dd1-898c-01f29cd13fc7 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c0b42a164964ff296253cb2e8ee9e93)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:29.951496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9064f7-a618-4dd1-898c-01f29cd13fc7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:29.953199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 114/226] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:20:29 2021] GET /identity/v3/users/8c0b42a164964ff296253cb2e8ee9e93 => generated 283 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:29.959479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4384c9-02ce-4a5d-bdcf-e7ca960a4964 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:29.970037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4384c9-02ce-4a5d-bdcf-e7ca960a4964 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:29.975740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e3b41-8fad-421e-9f7d-090a706ab0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:29.976358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e3b41-8fad-421e-9f7d-090a706ab0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:29.976645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e3b41-8fad-421e-9f7d-090a706ab0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:29.976921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e3b41-8fad-421e-9f7d-090a706ab0d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:29.986430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e3b41-8fad-421e-9f7d-090a706ab0d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:30.012616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e3b41-8fad-421e-9f7d-090a706ab0d4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:30.023077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 113/227] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:30.031174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9064f7-a618-4dd1-898c-01f29cd13fc7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:30.046708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9064f7-a618-4dd1-898c-01f29cd13fc7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:30.053721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b64bdf-0ec8-446b-a042-59c02eab3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:30.054578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64bdf-0ec8-446b-a042-59c02eab3fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:30.054855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64bdf-0ec8-446b-a042-59c02eab3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:30.055133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64bdf-0ec8-446b-a042-59c02eab3fe1 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:30.056555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b64bdf-0ec8-446b-a042-59c02eab3fe1 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:30.085301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b64bdf-0ec8-446b-a042-59c02eab3fe1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:30.087050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 115/228] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:30 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:30.093245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e3b41-8fad-421e-9f7d-090a706ab0d4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:30.102508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e3b41-8fad-421e-9f7d-090a706ab0d4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:30.107734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9e3bd-f4ee-4ee4-be14-62fc47bf6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:30.108315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9e3bd-f4ee-4ee4-be14-62fc47bf6a5f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:30.108596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9e3bd-f4ee-4ee4-be14-62fc47bf6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:30.108871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9e3bd-f4ee-4ee4-be14-62fc47bf6a5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:30.109668 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9e3bd-f4ee-4ee4-be14-62fc47bf6a5f admin admin] RBAC: Adding query filter params (role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc, user.id=8c0b42a164964ff296253cb2e8ee9e93) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:30.109963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9e3bd-f4ee-4ee4-be14-62fc47bf6a5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:30.135235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9e3bd-f4ee-4ee4-be14-62fc47bf6a5f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:30.142107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 114/229] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:20:30 2021] GET /identity/v3/role_assignments?user.id=8c0b42a164964ff296253cb2e8ee9e93&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:32.114270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dde68-85cb-47b7-9f04-ea39afbd8914 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:32.114822 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dde68-85cb-47b7-9f04-ea39afbd8914 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:32.114822 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dde68-85cb-47b7-9f04-ea39afbd8914 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:32.116526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 116/230] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:32.122700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e631037-3491-4dc8-990e-d3fb49d64e42 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:32.123213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e631037-3491-4dc8-990e-d3fb49d64e42 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:32.123293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e631037-3491-4dc8-990e-d3fb49d64e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:32.149540 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3e631037-3491-4dc8-990e-d3fb49d64e42 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:32.150736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3e631037-3491-4dc8-990e-d3fb49d64e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:32.159410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 115/231] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:32.182160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dde68-85cb-47b7-9f04-ea39afbd8914 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:32.195093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dde68-85cb-47b7-9f04-ea39afbd8914 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:32.199395 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0e6c0-5e43-4d8d-905e-a38f67312f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:32.200128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e6c0-5e43-4d8d-905e-a38f67312f7e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:32.200409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e6c0-5e43-4d8d-905e-a38f67312f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:32.200688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e6c0-5e43-4d8d-905e-a38f67312f7e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:32.201759 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0e6c0-5e43-4d8d-905e-a38f67312f7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:32.226991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0e6c0-5e43-4d8d-905e-a38f67312f7e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:32.228495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 117/232] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:20:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:32.234342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e631037-3491-4dc8-990e-d3fb49d64e42 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:32.243899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e631037-3491-4dc8-990e-d3fb49d64e42 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:32.249118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727936a5-1fc7-4d45-a94f-d939b6099ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:32.249728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727936a5-1fc7-4d45-a94f-d939b6099ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:32.250015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727936a5-1fc7-4d45-a94f-d939b6099ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:32.250320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727936a5-1fc7-4d45-a94f-d939b6099ae0 admin admin] PATH_INFO: `/v3/groups` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:32.250963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727936a5-1fc7-4d45-a94f-d939b6099ae0 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:32.276474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-727936a5-1fc7-4d45-a94f-d939b6099ae0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:20:32.276474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:20:32.276474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:20:32.277650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727936a5-1fc7-4d45-a94f-d939b6099ae0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:32.294566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 116/233] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Dec 16 14:20:32 2021] POST /identity/v3/groups => generated 229 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:20:34.277528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be60f-df57-473c-8fc1-846eafd6fa2b None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:34.278114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be60f-df57-473c-8fc1-846eafd6fa2b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:34.278114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be60f-df57-473c-8fc1-846eafd6fa2b None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:34.279860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 118/234] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:34.285966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f122ff-0bfb-439e-87e8-28ec655259ce None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:34.286562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f122ff-0bfb-439e-87e8-28ec655259ce None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:34.286562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f122ff-0bfb-439e-87e8-28ec655259ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:34.311850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-84f122ff-0bfb-439e-87e8-28ec655259ce None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:34.314728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-84f122ff-0bfb-439e-87e8-28ec655259ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:34.321151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 117/235] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:34.343167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2be60f-df57-473c-8fc1-846eafd6fa2b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:34.361426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2be60f-df57-473c-8fc1-846eafd6fa2b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:34.371479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518df6b-23e1-430e-916f-855586c8a773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:34.373301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518df6b-23e1-430e-916f-855586c8a773 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:34.374071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518df6b-23e1-430e-916f-855586c8a773 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:34.374789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518df6b-23e1-430e-916f-855586c8a773 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:34.377590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518df6b-23e1-430e-916f-855586c8a773 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:34.434435 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518df6b-23e1-430e-916f-855586c8a773 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:34.437274 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 119/236] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:20:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:34.446592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f122ff-0bfb-439e-87e8-28ec655259ce None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:34.461237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f122ff-0bfb-439e-87e8-28ec655259ce None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:34.466522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367546ef-5ef8-43a2-82ad-0916fffd117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:34.467116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367546ef-5ef8-43a2-82ad-0916fffd117d admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:34.467392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367546ef-5ef8-43a2-82ad-0916fffd117d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:34.467661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367546ef-5ef8-43a2-82ad-0916fffd117d admin admin] PATH_INFO: `/v3/groups` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:34.468301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367546ef-5ef8-43a2-82ad-0916fffd117d admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:34.493634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367546ef-5ef8-43a2-82ad-0916fffd117d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:34.510397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 118/237] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Dec 16 14:20:34 2021] POST /identity/v3/groups => generated 226 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:20:36.508829 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c81c7-0121-4bbe-8528-78f50c53e2c1 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:36.509350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c81c7-0121-4bbe-8528-78f50c53e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:36.509350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c81c7-0121-4bbe-8528-78f50c53e2c1 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:36.511067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 120/238] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:36.517141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bff4b-e061-4a53-b633-5ea21f1448b6 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:36.517788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bff4b-e061-4a53-b633-5ea21f1448b6 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:36.517788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bff4b-e061-4a53-b633-5ea21f1448b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:36.542538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-975bff4b-e061-4a53-b633-5ea21f1448b6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:36.543700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-975bff4b-e061-4a53-b633-5ea21f1448b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:36.551634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 119/239] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:36.575417 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c81c7-0121-4bbe-8528-78f50c53e2c1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:36.589306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c81c7-0121-4bbe-8528-78f50c53e2c1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:36.597099 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1734694-0547-482f-9001-549b8e21c0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:36.597541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1734694-0547-482f-9001-549b8e21c0ea admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:36.597827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1734694-0547-482f-9001-549b8e21c0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:36.598134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1734694-0547-482f-9001-549b8e21c0ea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:36.612418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1734694-0547-482f-9001-549b8e21c0ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:36.619199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-d1734694-0547-482f-9001-549b8e21c0ea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:36.620365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 121/240] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:36.626749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bff4b-e061-4a53-b633-5ea21f1448b6 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:36.636484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bff4b-e061-4a53-b633-5ea21f1448b6 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:36.640881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd01c6e-32b1-4324-8900-71d2b3693ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:36.641501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd01c6e-32b1-4324-8900-71d2b3693ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:36.641792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd01c6e-32b1-4324-8900-71d2b3693ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:36.642106 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd01c6e-32b1-4324-8900-71d2b3693ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:36.642850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd01c6e-32b1-4324-8900-71d2b3693ff8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:36.643155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd01c6e-32b1-4324-8900-71d2b3693ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:36.669100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd01c6e-32b1-4324-8900-71d2b3693ff8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:36.679636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 120/241] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:36.685787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1734694-0547-482f-9001-549b8e21c0ea admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:36.696391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1734694-0547-482f-9001-549b8e21c0ea admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:36.701709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30550e63-4971-4381-8de9-e38a5965f3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:36.702328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30550e63-4971-4381-8de9-e38a5965f3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:36.702612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30550e63-4971-4381-8de9-e38a5965f3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:36.702890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30550e63-4971-4381-8de9-e38a5965f3e9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:36.711452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30550e63-4971-4381-8de9-e38a5965f3e9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:36.736745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30550e63-4971-4381-8de9-e38a5965f3e9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:36.745949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 122/242] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:36.751876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd01c6e-32b1-4324-8900-71d2b3693ff8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:36.762022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd01c6e-32b1-4324-8900-71d2b3693ff8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:36.767258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62335f8d-db82-49cc-abe4-21c7d4e50de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:36.768063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62335f8d-db82-49cc-abe4-21c7d4e50de1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:36.768460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62335f8d-db82-49cc-abe4-21c7d4e50de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:36.769024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62335f8d-db82-49cc-abe4-21c7d4e50de1 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:36.769974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62335f8d-db82-49cc-abe4-21c7d4e50de1 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:36.795676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62335f8d-db82-49cc-abe4-21c7d4e50de1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:36.797268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 121/243] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:36 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:36.803555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30550e63-4971-4381-8de9-e38a5965f3e9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:36.812734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30550e63-4971-4381-8de9-e38a5965f3e9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:36.818218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e1547-611a-40b3-ab3d-e9d68e4bfcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:36.820078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e1547-611a-40b3-ab3d-e9d68e4bfcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:36.820078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e1547-611a-40b3-ab3d-e9d68e4bfcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:36.820078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e1547-611a-40b3-ab3d-e9d68e4bfcb5 admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:36.827136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e1547-611a-40b3-ab3d-e9d68e4bfcb5 admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:36.854021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-551e1547-611a-40b3-ab3d-e9d68e4bfcb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:20:36.854021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:20:36.854021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:20:36.855211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e1547-611a-40b3-ab3d-e9d68e4bfcb5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:36.856797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 123/244] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:36 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:36.863143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62335f8d-db82-49cc-abe4-21c7d4e50de1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:36.873199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62335f8d-db82-49cc-abe4-21c7d4e50de1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:36.878448 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6768fd-a5ce-4b43-a70a-6d034d417b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:36.879099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6768fd-a5ce-4b43-a70a-6d034d417b8b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:36.879383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6768fd-a5ce-4b43-a70a-6d034d417b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:36.879653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6768fd-a5ce-4b43-a70a-6d034d417b8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:36.880442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6768fd-a5ce-4b43-a70a-6d034d417b8b admin admin] RBAC: Adding query filter params (group.id=503c21cf140341708ff940a16e350b9a, role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:36.880739 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6768fd-a5ce-4b43-a70a-6d034d417b8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:36.906029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6768fd-a5ce-4b43-a70a-6d034d417b8b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:36.911556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 122/245] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:20:36 2021] GET /identity/v3/role_assignments?group.id=503c21cf140341708ff940a16e350b9a&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:38.897162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa991ce-afa0-413d-a2a1-1cd22c61fb46 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:38.897736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa991ce-afa0-413d-a2a1-1cd22c61fb46 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:38.897736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa991ce-afa0-413d-a2a1-1cd22c61fb46 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:38.899441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 124/246] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:38.905531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e5e9-b913-4450-ac29-c6e053d88af9 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:38.906067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e5e9-b913-4450-ac29-c6e053d88af9 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:38.906067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e5e9-b913-4450-ac29-c6e053d88af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:38.930821 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-6ba4e5e9-b913-4450-ac29-c6e053d88af9 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:38.931935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-6ba4e5e9-b913-4450-ac29-c6e053d88af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:38.940026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 123/247] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:38.962426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa991ce-afa0-413d-a2a1-1cd22c61fb46 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:38.976080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa991ce-afa0-413d-a2a1-1cd22c61fb46 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:38.980660 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3eb57-29e6-41b2-a29c-36ffe9284df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:38.981392 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3eb57-29e6-41b2-a29c-36ffe9284df2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:38.981678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3eb57-29e6-41b2-a29c-36ffe9284df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:38.981957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3eb57-29e6-41b2-a29c-36ffe9284df2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:38.994214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3eb57-29e6-41b2-a29c-36ffe9284df2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:39.000708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-23c3eb57-29e6-41b2-a29c-36ffe9284df2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:39.001865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 125/248] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:39.008151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e5e9-b913-4450-ac29-c6e053d88af9 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:39.017156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e5e9-b913-4450-ac29-c6e053d88af9 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:39.022414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9089b-196e-48ae-9da9-f2460e4bcf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:39.023024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9089b-196e-48ae-9da9-f2460e4bcf3e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:39.023305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9089b-196e-48ae-9da9-f2460e4bcf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:39.023575 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9089b-196e-48ae-9da9-f2460e4bcf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:39.024287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9089b-196e-48ae-9da9-f2460e4bcf3e admin admin] RBAC: Adding query filter params (name=member) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:39.024580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9089b-196e-48ae-9da9-f2460e4bcf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:39.050510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9089b-196e-48ae-9da9-f2460e4bcf3e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:39.059931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 124/249] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:39.066484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3eb57-29e6-41b2-a29c-36ffe9284df2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:39.076912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3eb57-29e6-41b2-a29c-36ffe9284df2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:39.081254 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f1d54-c721-4332-8ad0-0400e700017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:39.082034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f1d54-c721-4332-8ad0-0400e700017e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:39.082337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f1d54-c721-4332-8ad0-0400e700017e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:39.082609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f1d54-c721-4332-8ad0-0400e700017e admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:39.083683 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f1d54-c721-4332-8ad0-0400e700017e admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:39.109011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f1d54-c721-4332-8ad0-0400e700017e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:39.110510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 126/250] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:39 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:39.116072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9089b-196e-48ae-9da9-f2460e4bcf3e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:39.126057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9089b-196e-48ae-9da9-f2460e4bcf3e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:39.131298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0176d6-0e0c-41a1-a2ca-d2e7397fb3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:39.132085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0176d6-0e0c-41a1-a2ca-d2e7397fb3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:39.132366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0176d6-0e0c-41a1-a2ca-d2e7397fb3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:39.132640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0176d6-0e0c-41a1-a2ca-d2e7397fb3f5 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:39.133835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0176d6-0e0c-41a1-a2ca-d2e7397fb3f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:39.159678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0176d6-0e0c-41a1-a2ca-d2e7397fb3f5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:39.161196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 125/251] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:39 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:39.167088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f1d54-c721-4332-8ad0-0400e700017e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:39.177501 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f1d54-c721-4332-8ad0-0400e700017e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:39.184515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd888a-1f5a-4c59-9adc-2a4d4a2d41cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:39.185337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd888a-1f5a-4c59-9adc-2a4d4a2d41cd admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:39.185949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd888a-1f5a-4c59-9adc-2a4d4a2d41cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:39.185949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd888a-1f5a-4c59-9adc-2a4d4a2d41cd admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/groups/503c21cf140341708ff940a16e350b9a/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:39.188682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd888a-1f5a-4c59-9adc-2a4d4a2d41cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec15c254e4e4438ba97f65c3eb214d1d, group_id=503c21cf140341708ff940a16e350b9a, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:39.217737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd888a-1f5a-4c59-9adc-2a4d4a2d41cd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:39.231923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 127/252] 10.222.0.67 () {58 vars in 1463 bytes} [Thu Dec 16 14:20:39 2021] PUT /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/groups/503c21cf140341708ff940a16e350b9a/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:20:41.171884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cd7b-1e14-4ab2-a72a-aa563926614c None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:41.172499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cd7b-1e14-4ab2-a72a-aa563926614c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:41.172499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cd7b-1e14-4ab2-a72a-aa563926614c None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:41.174523 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 126/253] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:41.180778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a66f-9b6f-4a1b-b43c-4286e7b0332b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:41.181357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a66f-9b6f-4a1b-b43c-4286e7b0332b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:41.181357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806a66f-9b6f-4a1b-b43c-4286e7b0332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:41.206187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-3806a66f-9b6f-4a1b-b43c-4286e7b0332b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:41.207419 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3806a66f-9b6f-4a1b-b43c-4286e7b0332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:41.279349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 128/254] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:41.302727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5cd7b-1e14-4ab2-a72a-aa563926614c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:41.316963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5cd7b-1e14-4ab2-a72a-aa563926614c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:41.322123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ac47c-c0a7-4c64-8c6c-e4bc66ab50a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:41.322876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ac47c-c0a7-4c64-8c6c-e4bc66ab50a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:41.323161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ac47c-c0a7-4c64-8c6c-e4bc66ab50a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:41.323413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ac47c-c0a7-4c64-8c6c-e4bc66ab50a4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:41.335842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ac47c-c0a7-4c64-8c6c-e4bc66ab50a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:41.342379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-452ac47c-c0a7-4c64-8c6c-e4bc66ab50a4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:41.343542 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 127/255] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:41.349782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a66f-9b6f-4a1b-b43c-4286e7b0332b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:41.359200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806a66f-9b6f-4a1b-b43c-4286e7b0332b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:41.364581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5bbb2-900a-4dfc-b633-e459975050bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:41.365830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5bbb2-900a-4dfc-b633-e459975050bf admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:41.366080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5bbb2-900a-4dfc-b633-e459975050bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:41.366894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5bbb2-900a-4dfc-b633-e459975050bf admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:41.367128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5bbb2-900a-4dfc-b633-e459975050bf admin admin] RBAC: Adding query filter params (name=member) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:41.367429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5bbb2-900a-4dfc-b633-e459975050bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:41.394720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5bbb2-900a-4dfc-b633-e459975050bf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:41.404517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 129/256] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:41.410732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ac47c-c0a7-4c64-8c6c-e4bc66ab50a4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:41.420818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ac47c-c0a7-4c64-8c6c-e4bc66ab50a4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:41.426174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d2a6c-b46f-4a76-a7ad-e4a90aabd825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:41.426749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d2a6c-b46f-4a76-a7ad-e4a90aabd825 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:41.427034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d2a6c-b46f-4a76-a7ad-e4a90aabd825 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:41.427307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d2a6c-b46f-4a76-a7ad-e4a90aabd825 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:41.435614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d2a6c-b46f-4a76-a7ad-e4a90aabd825 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:41.469097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d2a6c-b46f-4a76-a7ad-e4a90aabd825 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:41.478374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 128/257] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:41.484380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5bbb2-900a-4dfc-b633-e459975050bf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:41.494506 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5bbb2-900a-4dfc-b633-e459975050bf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:41.499712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7149f-2dad-4ccd-8b74-1899708618d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:41.500505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7149f-2dad-4ccd-8b74-1899708618d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:41.500780 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7149f-2dad-4ccd-8b74-1899708618d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:41.501052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7149f-2dad-4ccd-8b74-1899708618d8 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:41.502300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7149f-2dad-4ccd-8b74-1899708618d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:41.528556 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7149f-2dad-4ccd-8b74-1899708618d8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:41.530120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 130/258] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:41 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:41.535892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d2a6c-b46f-4a76-a7ad-e4a90aabd825 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:41.544900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d2a6c-b46f-4a76-a7ad-e4a90aabd825 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:41.550548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cddc66-22fb-4952-98b1-1fa2ab196bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:41.551332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cddc66-22fb-4952-98b1-1fa2ab196bcb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:41.551617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cddc66-22fb-4952-98b1-1fa2ab196bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:41.551894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cddc66-22fb-4952-98b1-1fa2ab196bcb admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:41.553100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cddc66-22fb-4952-98b1-1fa2ab196bcb admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:41.577839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-91cddc66-22fb-4952-98b1-1fa2ab196bcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:20:41.577839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:20:41.577839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:20:41.579071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cddc66-22fb-4952-98b1-1fa2ab196bcb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:41.580729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 129/259] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:41 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:41.586584 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7149f-2dad-4ccd-8b74-1899708618d8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:41.596729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7149f-2dad-4ccd-8b74-1899708618d8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:41.601597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a273e91-afb1-493f-a8d5-8afeeb08af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:41.602226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a273e91-afb1-493f-a8d5-8afeeb08af9b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:41.602513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a273e91-afb1-493f-a8d5-8afeeb08af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:41.602789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a273e91-afb1-493f-a8d5-8afeeb08af9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:41.603576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a273e91-afb1-493f-a8d5-8afeeb08af9b admin admin] RBAC: Adding query filter params (group.id=503c21cf140341708ff940a16e350b9a, role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:41.603883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a273e91-afb1-493f-a8d5-8afeeb08af9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:41.629521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a273e91-afb1-493f-a8d5-8afeeb08af9b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:41.635842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 131/260] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:20:41 2021] GET /identity/v3/role_assignments?group.id=503c21cf140341708ff940a16e350b9a&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:43.655045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbdbca-d3b6-477f-9552-1902643c988a None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:43.655661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbdbca-d3b6-477f-9552-1902643c988a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:43.655661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbdbca-d3b6-477f-9552-1902643c988a None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:43.657328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 130/261] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:43.663154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1e0e7-d096-4647-9ec3-5d8567d70de4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:43.663576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1e0e7-d096-4647-9ec3-5d8567d70de4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:43.663679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1e0e7-d096-4647-9ec3-5d8567d70de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:43.687845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0fa1e0e7-d096-4647-9ec3-5d8567d70de4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:43.688981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0fa1e0e7-d096-4647-9ec3-5d8567d70de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:43.697186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 132/262] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:43.720608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbdbca-d3b6-477f-9552-1902643c988a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:43.734193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbdbca-d3b6-477f-9552-1902643c988a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:43.738808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33058721-2fbd-4d5b-8ceb-a8a91d306a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:43.739571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33058721-2fbd-4d5b-8ceb-a8a91d306a01 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:43.739858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33058721-2fbd-4d5b-8ceb-a8a91d306a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:43.740137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33058721-2fbd-4d5b-8ceb-a8a91d306a01 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:43.752835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33058721-2fbd-4d5b-8ceb-a8a91d306a01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:43.759654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-33058721-2fbd-4d5b-8ceb-a8a91d306a01 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:20:43.760757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 131/263] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:20:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:43.766555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1e0e7-d096-4647-9ec3-5d8567d70de4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:43.776168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1e0e7-d096-4647-9ec3-5d8567d70de4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:43.781361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e204e6-2a32-4c4b-9b2a-a1fa4e1d5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:43.781963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e204e6-2a32-4c4b-9b2a-a1fa4e1d5218 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:43.782274 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e204e6-2a32-4c4b-9b2a-a1fa4e1d5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:43.782549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e204e6-2a32-4c4b-9b2a-a1fa4e1d5218 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:43.783261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e204e6-2a32-4c4b-9b2a-a1fa4e1d5218 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:43.784135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e204e6-2a32-4c4b-9b2a-a1fa4e1d5218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:43.810049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e204e6-2a32-4c4b-9b2a-a1fa4e1d5218 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:43.819793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 133/264] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:20:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:43.825606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33058721-2fbd-4d5b-8ceb-a8a91d306a01 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:43.836490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33058721-2fbd-4d5b-8ceb-a8a91d306a01 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:43.840665 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0903c0-6ee5-4275-a7b4-56e726d6ca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:43.841231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0903c0-6ee5-4275-a7b4-56e726d6ca1a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:43.841526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0903c0-6ee5-4275-a7b4-56e726d6ca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:43.841806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0903c0-6ee5-4275-a7b4-56e726d6ca1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:43.849506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0903c0-6ee5-4275-a7b4-56e726d6ca1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:43.874781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0903c0-6ee5-4275-a7b4-56e726d6ca1a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:43.883824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 132/265] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:20:43.889614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e204e6-2a32-4c4b-9b2a-a1fa4e1d5218 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:43.899963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e204e6-2a32-4c4b-9b2a-a1fa4e1d5218 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:43.904814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45dd8e-537e-4b9c-93b1-d614f21b5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:43.905686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45dd8e-537e-4b9c-93b1-d614f21b5741 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:43.905912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45dd8e-537e-4b9c-93b1-d614f21b5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:43.906211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45dd8e-537e-4b9c-93b1-d614f21b5741 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:43.907406 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45dd8e-537e-4b9c-93b1-d614f21b5741 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:43.934650 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45dd8e-537e-4b9c-93b1-d614f21b5741 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:43.936337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 134/266] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:43 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:43.942117 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0903c0-6ee5-4275-a7b4-56e726d6ca1a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:43.950835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0903c0-6ee5-4275-a7b4-56e726d6ca1a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:43.955227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e028918-8f28-4f88-85d8-3a1afca82c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:43.956614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e028918-8f28-4f88-85d8-3a1afca82c5c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:43.956901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e028918-8f28-4f88-85d8-3a1afca82c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:43.957177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e028918-8f28-4f88-85d8-3a1afca82c5c admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:43.958310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e028918-8f28-4f88-85d8-3a1afca82c5c admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:43.991195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e028918-8f28-4f88-85d8-3a1afca82c5c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:43.993166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 133/267] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:43 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:44.001002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45dd8e-537e-4b9c-93b1-d614f21b5741 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:44.011368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45dd8e-537e-4b9c-93b1-d614f21b5741 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:44.016724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea871ca-59ff-4cb1-89c4-98ab3f115909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:44.017309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea871ca-59ff-4cb1-89c4-98ab3f115909 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:44.017595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea871ca-59ff-4cb1-89c4-98ab3f115909 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:44.018009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea871ca-59ff-4cb1-89c4-98ab3f115909 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:44.019025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea871ca-59ff-4cb1-89c4-98ab3f115909 admin admin] RBAC: Adding query filter params (group.id=503c21cf140341708ff940a16e350b9a, role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:44.019383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea871ca-59ff-4cb1-89c4-98ab3f115909 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:44.046655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea871ca-59ff-4cb1-89c4-98ab3f115909 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:44.053224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 135/268] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:20:43 2021] GET /identity/v3/role_assignments?group.id=503c21cf140341708ff940a16e350b9a&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 260 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:46.012709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd630a06-2a4c-4745-80af-03f7bd2b3445 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:46.013314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd630a06-2a4c-4745-80af-03f7bd2b3445 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:46.013314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd630a06-2a4c-4745-80af-03f7bd2b3445 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:46.015126 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 134/269] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:46.020661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e86a1-d38b-4cb7-9392-3de1e904e4f0 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:46.021117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e86a1-d38b-4cb7-9392-3de1e904e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:46.021204 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e86a1-d38b-4cb7-9392-3de1e904e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:46.044597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b18e86a1-d38b-4cb7-9392-3de1e904e4f0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:46.045764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b18e86a1-d38b-4cb7-9392-3de1e904e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:46.054021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 136/270] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:46.075698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd630a06-2a4c-4745-80af-03f7bd2b3445 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:46.087956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd630a06-2a4c-4745-80af-03f7bd2b3445 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:46.091952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d585779-17f6-4add-9d55-52272fe3d48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:46.092660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d585779-17f6-4add-9d55-52272fe3d48b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:46.092948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d585779-17f6-4add-9d55-52272fe3d48b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:46.093225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d585779-17f6-4add-9d55-52272fe3d48b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:46.104877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d585779-17f6-4add-9d55-52272fe3d48b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:46.111898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-6d585779-17f6-4add-9d55-52272fe3d48b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:20:46.113144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 135/271] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:20:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:46.119133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e86a1-d38b-4cb7-9392-3de1e904e4f0 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:46.127948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e86a1-d38b-4cb7-9392-3de1e904e4f0 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:46.132327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5cebb-a7ca-4d87-aa6f-7042f95475c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:46.132924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5cebb-a7ca-4d87-aa6f-7042f95475c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:46.133208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5cebb-a7ca-4d87-aa6f-7042f95475c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:46.133480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5cebb-a7ca-4d87-aa6f-7042f95475c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:46.134246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5cebb-a7ca-4d87-aa6f-7042f95475c8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:46.134537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5cebb-a7ca-4d87-aa6f-7042f95475c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:46.160258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5cebb-a7ca-4d87-aa6f-7042f95475c8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:46.169707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 137/272] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:20:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:46.176035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d585779-17f6-4add-9d55-52272fe3d48b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:46.187287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d585779-17f6-4add-9d55-52272fe3d48b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:46.192488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccfd57-d644-4c2a-867b-3f87895c238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:46.193271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccfd57-d644-4c2a-867b-3f87895c238f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:46.193551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccfd57-d644-4c2a-867b-3f87895c238f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:46.193815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccfd57-d644-4c2a-867b-3f87895c238f admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:46.195021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccfd57-d644-4c2a-867b-3f87895c238f admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:46.220470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccfd57-d644-4c2a-867b-3f87895c238f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:46.221943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 136/273] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:46 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:46.227677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5cebb-a7ca-4d87-aa6f-7042f95475c8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:46.237665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5cebb-a7ca-4d87-aa6f-7042f95475c8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:46.242908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c40b9-9cba-4e65-a5ed-2a9888613ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:46.243726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c40b9-9cba-4e65-a5ed-2a9888613ccb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:46.244005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c40b9-9cba-4e65-a5ed-2a9888613ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:46.244278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c40b9-9cba-4e65-a5ed-2a9888613ccb admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:46.245461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c40b9-9cba-4e65-a5ed-2a9888613ccb admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:46.271536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c40b9-9cba-4e65-a5ed-2a9888613ccb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:46.273043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 138/274] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:46 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:46.278954 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccfd57-d644-4c2a-867b-3f87895c238f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:46.289152 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccfd57-d644-4c2a-867b-3f87895c238f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:46.294396 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf012c01-c9fb-4764-90f4-4d3222a58bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:46.295227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf012c01-c9fb-4764-90f4-4d3222a58bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:46.295510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf012c01-c9fb-4764-90f4-4d3222a58bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:46.295794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf012c01-c9fb-4764-90f4-4d3222a58bc0 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/groups/503c21cf140341708ff940a16e350b9a/roles/066e315d3c6b43edbbe4609b54fc3a2a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:46.298449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf012c01-c9fb-4764-90f4-4d3222a58bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec15c254e4e4438ba97f65c3eb214d1d, group_id=503c21cf140341708ff940a16e350b9a, role_id=066e315d3c6b43edbbe4609b54fc3a2a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:46.324673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf012c01-c9fb-4764-90f4-4d3222a58bc0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:46.339038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 137/275] 10.222.0.67 () {58 vars in 1463 bytes} [Thu Dec 16 14:20:46 2021] PUT /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d/groups/503c21cf140341708ff940a16e350b9a/roles/066e315d3c6b43edbbe4609b54fc3a2a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:20:48.290569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8be7c-2de4-42f5-b114-594d5cdafd48 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:48.291149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8be7c-2de4-42f5-b114-594d5cdafd48 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:48.291149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8be7c-2de4-42f5-b114-594d5cdafd48 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:48.292847 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 139/276] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:48.299519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730b226-ce94-4543-88c4-c774be60369c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:48.300090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730b226-ce94-4543-88c4-c774be60369c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:48.300186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730b226-ce94-4543-88c4-c774be60369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:48.327097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c730b226-ce94-4543-88c4-c774be60369c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:48.328852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c730b226-ce94-4543-88c4-c774be60369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:48.400363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 138/277] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:48.423486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8be7c-2de4-42f5-b114-594d5cdafd48 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:48.436682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8be7c-2de4-42f5-b114-594d5cdafd48 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:48.441348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290740-a6c3-4f07-a438-1203b075f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:48.442137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290740-a6c3-4f07-a438-1203b075f00f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:48.442426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290740-a6c3-4f07-a438-1203b075f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:48.442708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290740-a6c3-4f07-a438-1203b075f00f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:48.458707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd290740-a6c3-4f07-a438-1203b075f00f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:48.465572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-bd290740-a6c3-4f07-a438-1203b075f00f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:20:48.466748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 140/278] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:20:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:48.472972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730b226-ce94-4543-88c4-c774be60369c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:48.482188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730b226-ce94-4543-88c4-c774be60369c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:48.487895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b20c48-e65e-4fab-b3d6-4bdd34105758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:48.488529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b20c48-e65e-4fab-b3d6-4bdd34105758 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:48.488806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b20c48-e65e-4fab-b3d6-4bdd34105758 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:48.489090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b20c48-e65e-4fab-b3d6-4bdd34105758 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:48.489805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b20c48-e65e-4fab-b3d6-4bdd34105758 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:48.490136 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b20c48-e65e-4fab-b3d6-4bdd34105758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:48.515870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b20c48-e65e-4fab-b3d6-4bdd34105758 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:48.525505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 139/279] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:20:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:48.531395 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290740-a6c3-4f07-a438-1203b075f00f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:48.541349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290740-a6c3-4f07-a438-1203b075f00f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:48.546283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef22e4f-9c50-4c2a-80da-62847ae2c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:48.546853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef22e4f-9c50-4c2a-80da-62847ae2c001 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:48.547129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef22e4f-9c50-4c2a-80da-62847ae2c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:48.547736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef22e4f-9c50-4c2a-80da-62847ae2c001 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:48.555898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef22e4f-9c50-4c2a-80da-62847ae2c001 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:48.581404 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef22e4f-9c50-4c2a-80da-62847ae2c001 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:48.590023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 141/280] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:48.595845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b20c48-e65e-4fab-b3d6-4bdd34105758 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:48.605432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b20c48-e65e-4fab-b3d6-4bdd34105758 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:48.609782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006b2a-7c95-463e-8c88-2c51a63ddd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:48.610622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006b2a-7c95-463e-8c88-2c51a63ddd60 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:48.610902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006b2a-7c95-463e-8c88-2c51a63ddd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:48.611302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006b2a-7c95-463e-8c88-2c51a63ddd60 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:48.612613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f006b2a-7c95-463e-8c88-2c51a63ddd60 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:48.638295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f006b2a-7c95-463e-8c88-2c51a63ddd60 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:48.639810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 140/281] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:48 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:48.645407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef22e4f-9c50-4c2a-80da-62847ae2c001 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:48.654457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef22e4f-9c50-4c2a-80da-62847ae2c001 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:48.659862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30fbab-d519-497e-aecc-1e1764c84616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:48.660659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30fbab-d519-497e-aecc-1e1764c84616 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:48.660936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30fbab-d519-497e-aecc-1e1764c84616 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:48.661202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30fbab-d519-497e-aecc-1e1764c84616 admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:48.662431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30fbab-d519-497e-aecc-1e1764c84616 admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:48.688545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30fbab-d519-497e-aecc-1e1764c84616 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:48.690239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 142/282] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:48 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:48.696095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006b2a-7c95-463e-8c88-2c51a63ddd60 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:48.706028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006b2a-7c95-463e-8c88-2c51a63ddd60 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:48.710603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d2e06-6760-4e43-93e2-de3687ed7b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:48.711197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d2e06-6760-4e43-93e2-de3687ed7b88 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:48.711475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d2e06-6760-4e43-93e2-de3687ed7b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:48.711751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d2e06-6760-4e43-93e2-de3687ed7b88 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:48.712503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d2e06-6760-4e43-93e2-de3687ed7b88 admin admin] RBAC: Adding query filter params (group.id=503c21cf140341708ff940a16e350b9a, role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:48.712813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d2e06-6760-4e43-93e2-de3687ed7b88 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:48.738559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d2e06-6760-4e43-93e2-de3687ed7b88 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:48.744650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 141/283] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:20:48 2021] GET /identity/v3/role_assignments?group.id=503c21cf140341708ff940a16e350b9a&scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:50.705684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134016d-f625-471d-bf1b-c951c84afda1 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:50.706292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134016d-f625-471d-bf1b-c951c84afda1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:50.706384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134016d-f625-471d-bf1b-c951c84afda1 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:50.708044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 143/284] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:50.713330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707823b-1f8f-4208-ae6c-0f92f098793c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:50.713777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707823b-1f8f-4208-ae6c-0f92f098793c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:50.713865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707823b-1f8f-4208-ae6c-0f92f098793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:50.738518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-1707823b-1f8f-4208-ae6c-0f92f098793c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:50.739663 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1707823b-1f8f-4208-ae6c-0f92f098793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:50.747493 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 142/285] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:50.770271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134016d-f625-471d-bf1b-c951c84afda1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:50.782901 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134016d-f625-471d-bf1b-c951c84afda1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:50.787021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875ab1a-bbd2-4ad1-8ed7-a9235da69d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:50.787766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875ab1a-bbd2-4ad1-8ed7-a9235da69d8c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:50.788077 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875ab1a-bbd2-4ad1-8ed7-a9235da69d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:50.788355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875ab1a-bbd2-4ad1-8ed7-a9235da69d8c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:50.800721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875ab1a-bbd2-4ad1-8ed7-a9235da69d8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:50.807376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-6875ab1a-bbd2-4ad1-8ed7-a9235da69d8c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:50.808538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 144/286] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:50.819293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707823b-1f8f-4208-ae6c-0f92f098793c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:50.829603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707823b-1f8f-4208-ae6c-0f92f098793c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:50.834944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7ca7c-82b2-4621-b3e6-87eb6aa3a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:50.835544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7ca7c-82b2-4621-b3e6-87eb6aa3a8fb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:50.835828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7ca7c-82b2-4621-b3e6-87eb6aa3a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:50.836110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7ca7c-82b2-4621-b3e6-87eb6aa3a8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:50.836800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7ca7c-82b2-4621-b3e6-87eb6aa3a8fb admin admin] RBAC: Adding query filter params (name=member) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:50.837100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7ca7c-82b2-4621-b3e6-87eb6aa3a8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:50.862462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7ca7c-82b2-4621-b3e6-87eb6aa3a8fb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:50.871987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 143/287] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:50.878026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875ab1a-bbd2-4ad1-8ed7-a9235da69d8c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:50.888966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875ab1a-bbd2-4ad1-8ed7-a9235da69d8c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:50.896047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b841f33-a458-4629-bdcf-a41188e989dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:50.896623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841f33-a458-4629-bdcf-a41188e989dc admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:50.896902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841f33-a458-4629-bdcf-a41188e989dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:50.897170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841f33-a458-4629-bdcf-a41188e989dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:50.905682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b841f33-a458-4629-bdcf-a41188e989dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:50.931604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b841f33-a458-4629-bdcf-a41188e989dc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:50.940071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 145/288] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:50.945822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7ca7c-82b2-4621-b3e6-87eb6aa3a8fb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:50.956549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7ca7c-82b2-4621-b3e6-87eb6aa3a8fb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:50.961703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfaa16-2445-4804-97ae-5bcf9f39f5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:50.962549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfaa16-2445-4804-97ae-5bcf9f39f5fa admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:50.962827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfaa16-2445-4804-97ae-5bcf9f39f5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:50.963102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfaa16-2445-4804-97ae-5bcf9f39f5fa admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:50.964319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbfaa16-2445-4804-97ae-5bcf9f39f5fa admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:50.991494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbfaa16-2445-4804-97ae-5bcf9f39f5fa admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:50.993127 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 144/289] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:50 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:50.998953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b841f33-a458-4629-bdcf-a41188e989dc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:51.008198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b841f33-a458-4629-bdcf-a41188e989dc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:51.013468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc70a8c-f7b4-473d-a2c3-ae5c490ef3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:51.014322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc70a8c-f7b4-473d-a2c3-ae5c490ef3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:51.014603 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc70a8c-f7b4-473d-a2c3-ae5c490ef3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:51.014872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc70a8c-f7b4-473d-a2c3-ae5c490ef3c7 admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:51.016045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc70a8c-f7b4-473d-a2c3-ae5c490ef3c7 admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:51.041924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc70a8c-f7b4-473d-a2c3-ae5c490ef3c7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:51.043410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 146/290] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:50 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:51.049612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfaa16-2445-4804-97ae-5bcf9f39f5fa admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:51.059706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfaa16-2445-4804-97ae-5bcf9f39f5fa admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:51.065197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb3cbb-c6b4-4f89-a1f9-45b1eb6a4c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:51.065787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb3cbb-c6b4-4f89-a1f9-45b1eb6a4c8a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:51.066094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb3cbb-c6b4-4f89-a1f9-45b1eb6a4c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:51.066373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb3cbb-c6b4-4f89-a1f9-45b1eb6a4c8a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:51.067162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb3cbb-c6b4-4f89-a1f9-45b1eb6a4c8a admin admin] RBAC: Adding query filter params (group.id=503c21cf140341708ff940a16e350b9a, role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:51.067459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb3cbb-c6b4-4f89-a1f9-45b1eb6a4c8a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:51.092863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb3cbb-c6b4-4f89-a1f9-45b1eb6a4c8a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:51.099025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 145/291] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:20:51 2021] GET /identity/v3/role_assignments?group.id=503c21cf140341708ff940a16e350b9a&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:20:53.036425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9f044-b02b-47b9-b3a6-ca65755390d0 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:53.037325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9f044-b02b-47b9-b3a6-ca65755390d0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:53.037325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9f044-b02b-47b9-b3a6-ca65755390d0 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:53.039584 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 147/292] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:53.048551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1254-10cd-45bb-8814-2b5aae58a8db None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:53.049553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1254-10cd-45bb-8814-2b5aae58a8db None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:53.049553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1254-10cd-45bb-8814-2b5aae58a8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:53.078492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-5d8d1254-10cd-45bb-8814-2b5aae58a8db None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:53.079719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5d8d1254-10cd-45bb-8814-2b5aae58a8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:53.087974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 146/293] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:53.110423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9f044-b02b-47b9-b3a6-ca65755390d0 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:53.126695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9f044-b02b-47b9-b3a6-ca65755390d0 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:53.130836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5340-3acb-4317-b1ee-bc840277fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:53.131572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5340-3acb-4317-b1ee-bc840277fb21 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:53.131856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5340-3acb-4317-b1ee-bc840277fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:53.132132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5340-3acb-4317-b1ee-bc840277fb21 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:53.144648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef5340-3acb-4317-b1ee-bc840277fb21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:53.151353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-09ef5340-3acb-4317-b1ee-bc840277fb21 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:53.152492 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 148/294] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:53.158793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1254-10cd-45bb-8814-2b5aae58a8db None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:53.168944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1254-10cd-45bb-8814-2b5aae58a8db None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:53.174654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4d41-32df-4f50-9f6f-e5c48cf9d514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:53.175265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4d41-32df-4f50-9f6f-e5c48cf9d514 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:53.175548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4d41-32df-4f50-9f6f-e5c48cf9d514 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:53.175826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4d41-32df-4f50-9f6f-e5c48cf9d514 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:53.176553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4d41-32df-4f50-9f6f-e5c48cf9d514 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:53.176850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4d41-32df-4f50-9f6f-e5c48cf9d514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:53.202357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4d41-32df-4f50-9f6f-e5c48cf9d514 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:53.212064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 147/295] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:53.218116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5340-3acb-4317-b1ee-bc840277fb21 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:53.229644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5340-3acb-4317-b1ee-bc840277fb21 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:53.234482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce027fd7-fbdc-4e8f-98f6-301a7bd64690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:53.235291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027fd7-fbdc-4e8f-98f6-301a7bd64690 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:53.235573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027fd7-fbdc-4e8f-98f6-301a7bd64690 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:53.236290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027fd7-fbdc-4e8f-98f6-301a7bd64690 admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:53.237486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce027fd7-fbdc-4e8f-98f6-301a7bd64690 admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:53.263862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce027fd7-fbdc-4e8f-98f6-301a7bd64690 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:53.265394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 149/296] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:53 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:53.271952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4d41-32df-4f50-9f6f-e5c48cf9d514 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:53.282222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4d41-32df-4f50-9f6f-e5c48cf9d514 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:53.287712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f20eb-3e16-4d9a-8706-69ec3ea59e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:53.288458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f20eb-3e16-4d9a-8706-69ec3ea59e44 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:53.288743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f20eb-3e16-4d9a-8706-69ec3ea59e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:53.289017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f20eb-3e16-4d9a-8706-69ec3ea59e44 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:53.290282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f20eb-3e16-4d9a-8706-69ec3ea59e44 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:53.316501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f20eb-3e16-4d9a-8706-69ec3ea59e44 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:53.318206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 148/297] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:53 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:53.323965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce027fd7-fbdc-4e8f-98f6-301a7bd64690 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:53.333894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce027fd7-fbdc-4e8f-98f6-301a7bd64690 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:53.338332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46462d9-68d3-4aae-ad17-abbca6df325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:53.339143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46462d9-68d3-4aae-ad17-abbca6df325f admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:53.339430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46462d9-68d3-4aae-ad17-abbca6df325f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:53.339711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46462d9-68d3-4aae-ad17-abbca6df325f admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/groups/503c21cf140341708ff940a16e350b9a/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:53.341541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46462d9-68d3-4aae-ad17-abbca6df325f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eda9161f20442c0af550cdfbd0da7dc, group_id=503c21cf140341708ff940a16e350b9a, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:53.367935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46462d9-68d3-4aae-ad17-abbca6df325f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:53.382807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 150/298] 10.222.0.67 () {58 vars in 1463 bytes} [Thu Dec 16 14:20:53 2021] PUT /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/groups/503c21cf140341708ff940a16e350b9a/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:20:55.335554 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a312-5538-4477-af16-e96a37ed1f4c None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:55.336182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a312-5538-4477-af16-e96a37ed1f4c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:55.336182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a312-5538-4477-af16-e96a37ed1f4c None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:55.337923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 149/299] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:55.344245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483cff-1009-4610-88dc-ca8a82d9b654 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:55.344830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483cff-1009-4610-88dc-ca8a82d9b654 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:55.344830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483cff-1009-4610-88dc-ca8a82d9b654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:55.369018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-4d483cff-1009-4610-88dc-ca8a82d9b654 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:55.370210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4d483cff-1009-4610-88dc-ca8a82d9b654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:55.441759 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 151/300] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:55.469313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0a312-5538-4477-af16-e96a37ed1f4c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:55.484604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0a312-5538-4477-af16-e96a37ed1f4c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:55.492173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6309e-8828-41fb-bc7a-88b2d2f3ed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:55.493104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6309e-8828-41fb-bc7a-88b2d2f3ed19 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:55.493388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6309e-8828-41fb-bc7a-88b2d2f3ed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:55.493663 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6309e-8828-41fb-bc7a-88b2d2f3ed19 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:55.508555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6309e-8828-41fb-bc7a-88b2d2f3ed19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:55.515177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-d6f6309e-8828-41fb-bc7a-88b2d2f3ed19 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 16 14:20:55.516321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 150/301] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:20:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:55.522722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d483cff-1009-4610-88dc-ca8a82d9b654 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:55.531788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d483cff-1009-4610-88dc-ca8a82d9b654 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:55.537089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3211c-d4f4-49a4-9b6a-08421945f730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:55.537698 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3211c-d4f4-49a4-9b6a-08421945f730 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:55.537962 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3211c-d4f4-49a4-9b6a-08421945f730 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:55.538284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3211c-d4f4-49a4-9b6a-08421945f730 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:55.539001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3211c-d4f4-49a4-9b6a-08421945f730 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:55.539295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3211c-d4f4-49a4-9b6a-08421945f730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:55.565113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3211c-d4f4-49a4-9b6a-08421945f730 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:55.574355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 152/302] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:20:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:55.580578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6309e-8828-41fb-bc7a-88b2d2f3ed19 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:55.590691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6309e-8828-41fb-bc7a-88b2d2f3ed19 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:55.595871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160d413-332d-4ea9-bcfa-429ea6d23f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:55.596456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160d413-332d-4ea9-bcfa-429ea6d23f29 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:55.596732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160d413-332d-4ea9-bcfa-429ea6d23f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:55.597003 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160d413-332d-4ea9-bcfa-429ea6d23f29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:55.605339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160d413-332d-4ea9-bcfa-429ea6d23f29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:55.631510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160d413-332d-4ea9-bcfa-429ea6d23f29 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:55.640563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 151/303] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:55.646712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3211c-d4f4-49a4-9b6a-08421945f730 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:55.656907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3211c-d4f4-49a4-9b6a-08421945f730 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:55.661711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400ed0-3629-4986-82f0-00240ae082ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:55.662553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400ed0-3629-4986-82f0-00240ae082ef admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:55.662837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400ed0-3629-4986-82f0-00240ae082ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:55.663113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400ed0-3629-4986-82f0-00240ae082ef admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:55.664371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9400ed0-3629-4986-82f0-00240ae082ef admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:55.690736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9400ed0-3629-4986-82f0-00240ae082ef admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:55.692361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 153/304] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:55 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:55.697969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160d413-332d-4ea9-bcfa-429ea6d23f29 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:55.707138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160d413-332d-4ea9-bcfa-429ea6d23f29 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:55.712280 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7f905-49f3-4712-b498-afb9b5d77316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:55.713061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7f905-49f3-4712-b498-afb9b5d77316 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:55.713341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7f905-49f3-4712-b498-afb9b5d77316 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:55.713609 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7f905-49f3-4712-b498-afb9b5d77316 admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:55.714788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7f905-49f3-4712-b498-afb9b5d77316 admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:55.740187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7f905-49f3-4712-b498-afb9b5d77316 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:55.741713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 152/305] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:55 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:55.747490 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400ed0-3629-4986-82f0-00240ae082ef admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:55.757365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400ed0-3629-4986-82f0-00240ae082ef admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:55.761754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9af35b-7fbd-4eb3-9b1a-cce0091d70ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:55.762352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af35b-7fbd-4eb3-9b1a-cce0091d70ba admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:55.762636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af35b-7fbd-4eb3-9b1a-cce0091d70ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:55.762911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af35b-7fbd-4eb3-9b1a-cce0091d70ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:55.763699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9af35b-7fbd-4eb3-9b1a-cce0091d70ba admin admin] RBAC: Adding query filter params (group.id=503c21cf140341708ff940a16e350b9a, role.id=a5fff0138d624c8e8151601f7ad2edb9, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:55.763996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9af35b-7fbd-4eb3-9b1a-cce0091d70ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:55.789770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9af35b-7fbd-4eb3-9b1a-cce0091d70ba admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:55.795593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 154/306] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:20:55 2021] GET /identity/v3/role_assignments?group.id=503c21cf140341708ff940a16e350b9a&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=a5fff0138d624c8e8151601f7ad2edb9 => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:57.778152 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921a05e-1a3b-4760-b117-ea1db22dde8c None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:57.779055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921a05e-1a3b-4760-b117-ea1db22dde8c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:57.779055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921a05e-1a3b-4760-b117-ea1db22dde8c None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:57.781186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 153/307] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:20:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:20:57.788015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3169-8918-4564-9ea2-11ba81372a4c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:57.788510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3169-8918-4564-9ea2-11ba81372a4c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:57.788510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3169-8918-4564-9ea2-11ba81372a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:57.812618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c7ef3169-8918-4564-9ea2-11ba81372a4c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:20:57.813851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c7ef3169-8918-4564-9ea2-11ba81372a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:20:57.821763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 155/308] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:20:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:20:57.844764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921a05e-1a3b-4760-b117-ea1db22dde8c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:57.857732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921a05e-1a3b-4760-b117-ea1db22dde8c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:57.861917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5894c-8053-4796-9e25-7bdd97005695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:57.862682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5894c-8053-4796-9e25-7bdd97005695 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:57.862967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5894c-8053-4796-9e25-7bdd97005695 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:57.863248 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5894c-8053-4796-9e25-7bdd97005695 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:57.875211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5894c-8053-4796-9e25-7bdd97005695 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:20:57.882611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-32d5894c-8053-4796-9e25-7bdd97005695 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:20:57.883758 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 154/309] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:20:57 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:20:57.889808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3169-8918-4564-9ea2-11ba81372a4c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:57.898808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3169-8918-4564-9ea2-11ba81372a4c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:57.902964 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195138b-8ee0-40a8-8fba-b5ac011eb324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:57.903550 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195138b-8ee0-40a8-8fba-b5ac011eb324 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:57.903833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195138b-8ee0-40a8-8fba-b5ac011eb324 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:57.904086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195138b-8ee0-40a8-8fba-b5ac011eb324 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:57.904808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195138b-8ee0-40a8-8fba-b5ac011eb324 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:57.905102 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195138b-8ee0-40a8-8fba-b5ac011eb324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:57.930798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195138b-8ee0-40a8-8fba-b5ac011eb324 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:57.939948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 156/310] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:20:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:57.945816 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5894c-8053-4796-9e25-7bdd97005695 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:57.957385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5894c-8053-4796-9e25-7bdd97005695 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:57.962065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1647fb-6b9d-424e-a99b-d6386cc446b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:57.962676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1647fb-6b9d-424e-a99b-d6386cc446b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:57.962962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1647fb-6b9d-424e-a99b-d6386cc446b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:57.963237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1647fb-6b9d-424e-a99b-d6386cc446b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:57.971775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1647fb-6b9d-424e-a99b-d6386cc446b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:57.997040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1647fb-6b9d-424e-a99b-d6386cc446b8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:58.006020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 155/311] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:20:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:20:58.011911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195138b-8ee0-40a8-8fba-b5ac011eb324 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:58.021657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195138b-8ee0-40a8-8fba-b5ac011eb324 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:58.026574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25532e-0b4e-4a05-ae1c-258427aaa6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:58.027354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25532e-0b4e-4a05-ae1c-258427aaa6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:58.027631 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25532e-0b4e-4a05-ae1c-258427aaa6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:58.027900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25532e-0b4e-4a05-ae1c-258427aaa6b5 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:58.029218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25532e-0b4e-4a05-ae1c-258427aaa6b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:58.056928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25532e-0b4e-4a05-ae1c-258427aaa6b5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:58.058493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 157/312] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:20:58 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:58.064022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1647fb-6b9d-424e-a99b-d6386cc446b8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:58.073002 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1647fb-6b9d-424e-a99b-d6386cc446b8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:58.078291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e2f49-cf53-48f0-a822-d7ddf1608ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:58.079598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2f49-cf53-48f0-a822-d7ddf1608ada admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:58.079598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2f49-cf53-48f0-a822-d7ddf1608ada admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:58.079910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2f49-cf53-48f0-a822-d7ddf1608ada admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:58.081133 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e2f49-cf53-48f0-a822-d7ddf1608ada admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:58.106841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e2f49-cf53-48f0-a822-d7ddf1608ada admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:58.108313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 156/313] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:20:58 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:20:58.114502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25532e-0b4e-4a05-ae1c-258427aaa6b5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:20:58.124745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25532e-0b4e-4a05-ae1c-258427aaa6b5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:20:58.129926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1749f1-0f02-4d77-85c3-296d554234ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:20:58.130648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1749f1-0f02-4d77-85c3-296d554234ee admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:20:58.130999 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1749f1-0f02-4d77-85c3-296d554234ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:20:58.131282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1749f1-0f02-4d77-85c3-296d554234ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:20:58.132071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1749f1-0f02-4d77-85c3-296d554234ee admin admin] RBAC: Adding query filter params (group.id=503c21cf140341708ff940a16e350b9a, role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:20:58.132374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1749f1-0f02-4d77-85c3-296d554234ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:20:58.158281 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1749f1-0f02-4d77-85c3-296d554234ee admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:20:58.164159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 158/314] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:20:58 2021] GET /identity/v3/role_assignments?group.id=503c21cf140341708ff940a16e350b9a&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:00.155231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1beb-d6af-4ece-a982-92a47c1eacc0 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:00.156133 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1beb-d6af-4ece-a982-92a47c1eacc0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:00.156410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1beb-d6af-4ece-a982-92a47c1eacc0 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:00.158949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 157/315] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:00.165233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e974ef-156d-449b-ab72-21f54e82a049 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:00.165767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e974ef-156d-449b-ab72-21f54e82a049 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:00.165767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e974ef-156d-449b-ab72-21f54e82a049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:00.190586 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d6e974ef-156d-449b-ab72-21f54e82a049 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:00.191742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d6e974ef-156d-449b-ab72-21f54e82a049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:00.198961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 159/316] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:00.221437 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1beb-d6af-4ece-a982-92a47c1eacc0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:00.234236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1beb-d6af-4ece-a982-92a47c1eacc0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:00.239251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70a884-9d05-4884-9349-8023a8bd09ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:00.240004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70a884-9d05-4884-9349-8023a8bd09ea admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:00.240277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70a884-9d05-4884-9349-8023a8bd09ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:00.240551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70a884-9d05-4884-9349-8023a8bd09ea admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:00.253287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70a884-9d05-4884-9349-8023a8bd09ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:00.260223 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-5f70a884-9d05-4884-9349-8023a8bd09ea admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:21:00.261387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 158/317] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:21:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:00.268052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e974ef-156d-449b-ab72-21f54e82a049 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:00.277398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e974ef-156d-449b-ab72-21f54e82a049 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:00.282637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c0957-02e8-4531-8fbd-627beef2ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:00.283254 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c0957-02e8-4531-8fbd-627beef2ab07 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:00.283534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c0957-02e8-4531-8fbd-627beef2ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:00.283810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c0957-02e8-4531-8fbd-627beef2ab07 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:00.284550 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c0957-02e8-4531-8fbd-627beef2ab07 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:00.284848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c0957-02e8-4531-8fbd-627beef2ab07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:00.310799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c0957-02e8-4531-8fbd-627beef2ab07 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:00.320570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 160/318] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:00.326501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70a884-9d05-4884-9349-8023a8bd09ea admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:00.337704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70a884-9d05-4884-9349-8023a8bd09ea admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:00.342936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3938c5-8323-474f-a26f-3a733f37c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:00.343722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3938c5-8323-474f-a26f-3a733f37c498 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:00.343997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3938c5-8323-474f-a26f-3a733f37c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:00.344271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3938c5-8323-474f-a26f-3a733f37c498 admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:00.345505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3938c5-8323-474f-a26f-3a733f37c498 admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:00.371149 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3938c5-8323-474f-a26f-3a733f37c498 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:00.372684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 159/319] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:21:00 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:00.378523 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c0957-02e8-4531-8fbd-627beef2ab07 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:00.388692 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c0957-02e8-4531-8fbd-627beef2ab07 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:00.393672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fda80a-b830-48e3-aa59-758327d00b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:00.394529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fda80a-b830-48e3-aa59-758327d00b8a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:00.394814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fda80a-b830-48e3-aa59-758327d00b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:00.395093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fda80a-b830-48e3-aa59-758327d00b8a admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:00.396292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fda80a-b830-48e3-aa59-758327d00b8a admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:00.422657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fda80a-b830-48e3-aa59-758327d00b8a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:00.424327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 161/320] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:21:00 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:00.430320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3938c5-8323-474f-a26f-3a733f37c498 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:00.440135 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3938c5-8323-474f-a26f-3a733f37c498 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:00.445274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efb00d-d001-4251-a3ce-735ac2fa296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:00.446178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efb00d-d001-4251-a3ce-735ac2fa296b admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:00.446462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efb00d-d001-4251-a3ce-735ac2fa296b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:00.446736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efb00d-d001-4251-a3ce-735ac2fa296b admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/groups/503c21cf140341708ff940a16e350b9a/roles/066e315d3c6b43edbbe4609b54fc3a2a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:00.449085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efb00d-d001-4251-a3ce-735ac2fa296b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eda9161f20442c0af550cdfbd0da7dc, group_id=503c21cf140341708ff940a16e350b9a, role_id=066e315d3c6b43edbbe4609b54fc3a2a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:00.475330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efb00d-d001-4251-a3ce-735ac2fa296b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:00.489466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 160/321] 10.222.0.67 () {58 vars in 1463 bytes} [Thu Dec 16 14:21:00 2021] PUT /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc/groups/503c21cf140341708ff940a16e350b9a/roles/066e315d3c6b43edbbe4609b54fc3a2a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:21:02.425769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58033b56-679f-44a9-b9e2-a270cf3bdef6 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:02.426371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58033b56-679f-44a9-b9e2-a270cf3bdef6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:02.426371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58033b56-679f-44a9-b9e2-a270cf3bdef6 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:02.427945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 162/322] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:02.433593 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56454f-983b-4aaa-ac22-e41ce385921a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:02.434098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56454f-983b-4aaa-ac22-e41ce385921a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:02.434195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56454f-983b-4aaa-ac22-e41ce385921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:02.467041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4d56454f-983b-4aaa-ac22-e41ce385921a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:02.468243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4d56454f-983b-4aaa-ac22-e41ce385921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:02.540113 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 161/323] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:02.563879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58033b56-679f-44a9-b9e2-a270cf3bdef6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:02.577671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58033b56-679f-44a9-b9e2-a270cf3bdef6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:02.582238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826cce8-fdc8-40b0-a9f0-4ceb39157196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:02.583017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826cce8-fdc8-40b0-a9f0-4ceb39157196 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:02.583298 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826cce8-fdc8-40b0-a9f0-4ceb39157196 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:02.583580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826cce8-fdc8-40b0-a9f0-4ceb39157196 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:02.597956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826cce8-fdc8-40b0-a9f0-4ceb39157196 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:02.604891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-f826cce8-fdc8-40b0-a9f0-4ceb39157196 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:21:02.606020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 163/324] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:21:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:02.612361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56454f-983b-4aaa-ac22-e41ce385921a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:02.621323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56454f-983b-4aaa-ac22-e41ce385921a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:02.626618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c5553-0bfa-47da-88a1-834146a40325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:02.627312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5553-0bfa-47da-88a1-834146a40325 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:02.627599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5553-0bfa-47da-88a1-834146a40325 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:02.627871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5553-0bfa-47da-88a1-834146a40325 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:02.628602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c5553-0bfa-47da-88a1-834146a40325 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:02.628895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c5553-0bfa-47da-88a1-834146a40325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:02.654175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c5553-0bfa-47da-88a1-834146a40325 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:02.663584 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 162/325] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:02.669596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826cce8-fdc8-40b0-a9f0-4ceb39157196 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:02.680014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826cce8-fdc8-40b0-a9f0-4ceb39157196 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:02.685238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40950fa-75d1-4f8e-93a4-14d8010bbd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:02.685820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40950fa-75d1-4f8e-93a4-14d8010bbd70 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:02.686214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40950fa-75d1-4f8e-93a4-14d8010bbd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:02.686496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40950fa-75d1-4f8e-93a4-14d8010bbd70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:02.694986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40950fa-75d1-4f8e-93a4-14d8010bbd70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:02.720640 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40950fa-75d1-4f8e-93a4-14d8010bbd70 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:02.729844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 164/326] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:02.735871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c5553-0bfa-47da-88a1-834146a40325 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:02.745810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c5553-0bfa-47da-88a1-834146a40325 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:02.751131 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06effdd-aac3-4282-beed-65b2a89b7100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:02.752029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06effdd-aac3-4282-beed-65b2a89b7100 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:02.752314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06effdd-aac3-4282-beed-65b2a89b7100 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:02.752590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06effdd-aac3-4282-beed-65b2a89b7100 admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:02.753847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06effdd-aac3-4282-beed-65b2a89b7100 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:02.779855 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06effdd-aac3-4282-beed-65b2a89b7100 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:02.781414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 163/327] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:21:02 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:02.787619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40950fa-75d1-4f8e-93a4-14d8010bbd70 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:02.796866 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40950fa-75d1-4f8e-93a4-14d8010bbd70 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:02.801396 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bcc14-bfa9-4cd1-93f7-9caa672c5290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:02.802214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bcc14-bfa9-4cd1-93f7-9caa672c5290 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:02.802501 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bcc14-bfa9-4cd1-93f7-9caa672c5290 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:02.802775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bcc14-bfa9-4cd1-93f7-9caa672c5290 admin admin] PATH_INFO: `/v3/groups/503c21cf140341708ff940a16e350b9a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:02.803895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bcc14-bfa9-4cd1-93f7-9caa672c5290 admin admin] RBAC: Authorizing `identity:get_group(group_id=503c21cf140341708ff940a16e350b9a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:02.829821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bcc14-bfa9-4cd1-93f7-9caa672c5290 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:02.831311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 165/328] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:21:02 2021] GET /identity/v3/groups/503c21cf140341708ff940a16e350b9a => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:02.836970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06effdd-aac3-4282-beed-65b2a89b7100 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:02.846692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06effdd-aac3-4282-beed-65b2a89b7100 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:02.851110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6c86f-715b-4931-9ddd-6f530efea4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:02.851686 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c86f-715b-4931-9ddd-6f530efea4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:02.851965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c86f-715b-4931-9ddd-6f530efea4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:02.852273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6c86f-715b-4931-9ddd-6f530efea4b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:02.853081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6c86f-715b-4931-9ddd-6f530efea4b0 admin admin] RBAC: Adding query filter params (group.id=503c21cf140341708ff940a16e350b9a, role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=2eda9161f20442c0af550cdfbd0da7dc) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:02.853387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6c86f-715b-4931-9ddd-6f530efea4b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:02.879086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6c86f-715b-4931-9ddd-6f530efea4b0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:02.885106 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 164/329] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:21:02 2021] GET /identity/v3/role_assignments?group.id=503c21cf140341708ff940a16e350b9a&scope.project.id=2eda9161f20442c0af550cdfbd0da7dc&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:04.863214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32f24e-11cb-4328-8188-c1252e62de8b None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:04.863835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32f24e-11cb-4328-8188-c1252e62de8b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:04.863835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32f24e-11cb-4328-8188-c1252e62de8b None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:04.865511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 166/330] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:04.871666 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030bbbb-3589-4e85-b8e4-fe54ec7a334a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:04.872247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030bbbb-3589-4e85-b8e4-fe54ec7a334a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:04.872247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030bbbb-3589-4e85-b8e4-fe54ec7a334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:04.897175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e030bbbb-3589-4e85-b8e4-fe54ec7a334a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:04.898410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e030bbbb-3589-4e85-b8e4-fe54ec7a334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:04.907038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 165/331] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:04.930557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32f24e-11cb-4328-8188-c1252e62de8b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:04.944671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32f24e-11cb-4328-8188-c1252e62de8b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:04.951092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003e53-bbf1-4f21-bcfc-ad1bedd3d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:04.951871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003e53-bbf1-4f21-bcfc-ad1bedd3d92b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:04.952224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003e53-bbf1-4f21-bcfc-ad1bedd3d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:04.952629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003e53-bbf1-4f21-bcfc-ad1bedd3d92b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:04.965211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf003e53-bbf1-4f21-bcfc-ad1bedd3d92b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:04.971749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-cf003e53-bbf1-4f21-bcfc-ad1bedd3d92b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:21:04.972879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 167/332] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:21:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:04.978972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030bbbb-3589-4e85-b8e4-fe54ec7a334a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:04.987966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030bbbb-3589-4e85-b8e4-fe54ec7a334a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:04.992946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b90b4-44a1-408d-a70a-71c41a3f5575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:04.993550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b90b4-44a1-408d-a70a-71c41a3f5575 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:04.993827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b90b4-44a1-408d-a70a-71c41a3f5575 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:04.994137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b90b4-44a1-408d-a70a-71c41a3f5575 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:04.994843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b90b4-44a1-408d-a70a-71c41a3f5575 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:04.995139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b90b4-44a1-408d-a70a-71c41a3f5575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:05.020505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b90b4-44a1-408d-a70a-71c41a3f5575 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:05.029738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 166/333] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:21:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:05.035930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003e53-bbf1-4f21-bcfc-ad1bedd3d92b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:05.047339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003e53-bbf1-4f21-bcfc-ad1bedd3d92b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:05.052697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20143d-6145-4cd7-93ac-3960a5b358c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:05.053282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20143d-6145-4cd7-93ac-3960a5b358c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:05.053565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20143d-6145-4cd7-93ac-3960a5b358c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:05.053808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20143d-6145-4cd7-93ac-3960a5b358c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:05.062344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20143d-6145-4cd7-93ac-3960a5b358c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:05.088095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20143d-6145-4cd7-93ac-3960a5b358c2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:05.097476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 168/334] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:05.103895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b90b4-44a1-408d-a70a-71c41a3f5575 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:05.114919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b90b4-44a1-408d-a70a-71c41a3f5575 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:05.119945 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171dff6-332b-4a57-a26d-3cd2790c4095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:05.120750 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171dff6-332b-4a57-a26d-3cd2790c4095 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:05.121032 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171dff6-332b-4a57-a26d-3cd2790c4095 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:05.121309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171dff6-332b-4a57-a26d-3cd2790c4095 admin admin] PATH_INFO: `/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:05.122545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171dff6-332b-4a57-a26d-3cd2790c4095 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ccd5dcafb684ba88fe8fe109a2798be)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:05.149051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171dff6-332b-4a57-a26d-3cd2790c4095 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:05.150873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 167/335] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:21:05 2021] GET /identity/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be => generated 344 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:05.156797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20143d-6145-4cd7-93ac-3960a5b358c2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:05.166512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20143d-6145-4cd7-93ac-3960a5b358c2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:05.172209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8122f-3bea-4462-9b8c-378e8109ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:05.173059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8122f-3bea-4462-9b8c-378e8109ad58 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:05.173341 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8122f-3bea-4462-9b8c-378e8109ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:05.173614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8122f-3bea-4462-9b8c-378e8109ad58 admin admin] PATH_INFO: `/v3/groups/043e5f1ebcb04a36aeb0d69e42deb363` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:05.178973 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8122f-3bea-4462-9b8c-378e8109ad58 admin admin] RBAC: Authorizing `identity:get_group(group_id=043e5f1ebcb04a36aeb0d69e42deb363)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:05.204641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8122f-3bea-4462-9b8c-378e8109ad58 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:05.206155 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 169/336] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:21:05 2021] GET /identity/v3/groups/043e5f1ebcb04a36aeb0d69e42deb363 => generated 229 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:05.211981 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171dff6-332b-4a57-a26d-3cd2790c4095 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:05.222024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171dff6-332b-4a57-a26d-3cd2790c4095 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:05.227160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e82740-9d9d-483f-a3b7-087822c008bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:05.227738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e82740-9d9d-483f-a3b7-087822c008bd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:05.228016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e82740-9d9d-483f-a3b7-087822c008bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:05.228288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e82740-9d9d-483f-a3b7-087822c008bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:05.229061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e82740-9d9d-483f-a3b7-087822c008bd admin admin] RBAC: Adding query filter params (group.id=043e5f1ebcb04a36aeb0d69e42deb363, role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=5ccd5dcafb684ba88fe8fe109a2798be) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:05.229357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e82740-9d9d-483f-a3b7-087822c008bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:05.255198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e82740-9d9d-483f-a3b7-087822c008bd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:05.260984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 168/337] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:21:05 2021] GET /identity/v3/role_assignments?group.id=043e5f1ebcb04a36aeb0d69e42deb363&scope.project.id=5ccd5dcafb684ba88fe8fe109a2798be&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:07.306368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceaafb-f8e2-4073-948e-e3a5bbcae74f None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:07.306915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceaafb-f8e2-4073-948e-e3a5bbcae74f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:07.306915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceaafb-f8e2-4073-948e-e3a5bbcae74f None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:07.308615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 170/338] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:07.314392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210bd8e-d4ff-4d17-936e-e40edd37ca15 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:07.314852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210bd8e-d4ff-4d17-936e-e40edd37ca15 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:07.314943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210bd8e-d4ff-4d17-936e-e40edd37ca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:07.341360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f210bd8e-d4ff-4d17-936e-e40edd37ca15 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:07.342550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f210bd8e-d4ff-4d17-936e-e40edd37ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:07.350538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 169/339] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:07.373191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceaafb-f8e2-4073-948e-e3a5bbcae74f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:07.387482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceaafb-f8e2-4073-948e-e3a5bbcae74f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:07.392353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7777-1308-4a8b-bec5-da34b2543397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:07.393130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7777-1308-4a8b-bec5-da34b2543397 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:07.393419 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7777-1308-4a8b-bec5-da34b2543397 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:07.393703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7777-1308-4a8b-bec5-da34b2543397 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:07.408272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d7777-1308-4a8b-bec5-da34b2543397 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:07.415149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-d22d7777-1308-4a8b-bec5-da34b2543397 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:21:07.416356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 171/340] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:21:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:07.423198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210bd8e-d4ff-4d17-936e-e40edd37ca15 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:07.433176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210bd8e-d4ff-4d17-936e-e40edd37ca15 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:07.438767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6c118-7da7-41f3-99eb-7b031f4a78dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:07.439464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6c118-7da7-41f3-99eb-7b031f4a78dc admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:07.439766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6c118-7da7-41f3-99eb-7b031f4a78dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:07.440042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6c118-7da7-41f3-99eb-7b031f4a78dc admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:07.440820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6c118-7da7-41f3-99eb-7b031f4a78dc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:07.441124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6c118-7da7-41f3-99eb-7b031f4a78dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:07.466751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6c118-7da7-41f3-99eb-7b031f4a78dc admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:07.477043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 170/341] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:21:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:07.483103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7777-1308-4a8b-bec5-da34b2543397 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:07.495157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7777-1308-4a8b-bec5-da34b2543397 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:07.500246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313f14-8e81-402a-9d77-f827d6c0fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:07.501871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313f14-8e81-402a-9d77-f827d6c0fade admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:07.502186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313f14-8e81-402a-9d77-f827d6c0fade admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:07.502470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313f14-8e81-402a-9d77-f827d6c0fade admin admin] PATH_INFO: `/v3/groups/043e5f1ebcb04a36aeb0d69e42deb363` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:07.503695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58313f14-8e81-402a-9d77-f827d6c0fade admin admin] RBAC: Authorizing `identity:get_group(group_id=043e5f1ebcb04a36aeb0d69e42deb363)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:07.545239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58313f14-8e81-402a-9d77-f827d6c0fade admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:07.548674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 172/342] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:21:07 2021] GET /identity/v3/groups/043e5f1ebcb04a36aeb0d69e42deb363 => generated 229 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:07.556251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6c118-7da7-41f3-99eb-7b031f4a78dc admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:07.566988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6c118-7da7-41f3-99eb-7b031f4a78dc admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:07.571331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0713c6e-9a0c-4083-b9f5-cdfd95b438ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:07.572170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0713c6e-9a0c-4083-b9f5-cdfd95b438ce admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:07.572442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0713c6e-9a0c-4083-b9f5-cdfd95b438ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:07.572718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0713c6e-9a0c-4083-b9f5-cdfd95b438ce admin admin] PATH_INFO: `/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:07.573841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0713c6e-9a0c-4083-b9f5-cdfd95b438ce admin admin] RBAC: Authorizing `identity:get_project(project_id=5ccd5dcafb684ba88fe8fe109a2798be)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:07.603704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0713c6e-9a0c-4083-b9f5-cdfd95b438ce admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:07.605395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 171/343] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:21:07 2021] GET /identity/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be => generated 344 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:21:07.611807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313f14-8e81-402a-9d77-f827d6c0fade admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:07.621913 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313f14-8e81-402a-9d77-f827d6c0fade admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:07.627184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92ff1e-3cc3-490c-aff5-eef41e696268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:07.627989 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92ff1e-3cc3-490c-aff5-eef41e696268 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:07.628280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92ff1e-3cc3-490c-aff5-eef41e696268 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:07.628560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92ff1e-3cc3-490c-aff5-eef41e696268 admin admin] PATH_INFO: `/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be/groups/043e5f1ebcb04a36aeb0d69e42deb363/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:07.630510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92ff1e-3cc3-490c-aff5-eef41e696268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccd5dcafb684ba88fe8fe109a2798be, group_id=043e5f1ebcb04a36aeb0d69e42deb363, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:07.657659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92ff1e-3cc3-490c-aff5-eef41e696268 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:07.673448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 173/344] 10.222.0.67 () {58 vars in 1463 bytes} [Thu Dec 16 14:21:07 2021] PUT /identity/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be/groups/043e5f1ebcb04a36aeb0d69e42deb363/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:21:09.654671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a05c3-7a7d-444d-b00a-0e9405507978 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:09.655341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a05c3-7a7d-444d-b00a-0e9405507978 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:09.655341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a05c3-7a7d-444d-b00a-0e9405507978 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:09.657106 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 172/345] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:09.663332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68629-8cd0-4ebc-a22f-466f6ef222aa None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:09.663911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68629-8cd0-4ebc-a22f-466f6ef222aa None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:09.663911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68629-8cd0-4ebc-a22f-466f6ef222aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:09.689022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0fc68629-8cd0-4ebc-a22f-466f6ef222aa None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:09.690233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0fc68629-8cd0-4ebc-a22f-466f6ef222aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:09.765830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 174/346] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:09.791040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a05c3-7a7d-444d-b00a-0e9405507978 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:09.804565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a05c3-7a7d-444d-b00a-0e9405507978 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:09.808909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50cccf-61a0-4815-9ab8-89a5cbd1abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:09.809628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50cccf-61a0-4815-9ab8-89a5cbd1abe9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:09.809900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50cccf-61a0-4815-9ab8-89a5cbd1abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:09.810200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50cccf-61a0-4815-9ab8-89a5cbd1abe9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:09.822823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50cccf-61a0-4815-9ab8-89a5cbd1abe9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:09.829432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-2e50cccf-61a0-4815-9ab8-89a5cbd1abe9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:21:09.830590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 173/347] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:21:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:09.836770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc68629-8cd0-4ebc-a22f-466f6ef222aa None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:09.846266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc68629-8cd0-4ebc-a22f-466f6ef222aa None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:09.851103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42152ba-f62a-4b85-b471-f9a17965c7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:09.851707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42152ba-f62a-4b85-b471-f9a17965c7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:09.851989 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42152ba-f62a-4b85-b471-f9a17965c7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:09.852263 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42152ba-f62a-4b85-b471-f9a17965c7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:09.853011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42152ba-f62a-4b85-b471-f9a17965c7e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:09.853307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42152ba-f62a-4b85-b471-f9a17965c7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:09.880743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42152ba-f62a-4b85-b471-f9a17965c7e6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:09.889933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 175/348] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:21:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:21:09.896265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50cccf-61a0-4815-9ab8-89a5cbd1abe9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:09.907588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50cccf-61a0-4815-9ab8-89a5cbd1abe9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:09.912736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fad9e0-6508-4cc4-b0ac-7227c44495b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:09.913329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fad9e0-6508-4cc4-b0ac-7227c44495b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:09.913616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fad9e0-6508-4cc4-b0ac-7227c44495b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:09.913898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fad9e0-6508-4cc4-b0ac-7227c44495b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:09.923596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fad9e0-6508-4cc4-b0ac-7227c44495b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:09.949096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fad9e0-6508-4cc4-b0ac-7227c44495b7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:09.959714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 174/349] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:09.965621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42152ba-f62a-4b85-b471-f9a17965c7e6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:09.975841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42152ba-f62a-4b85-b471-f9a17965c7e6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:09.981086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b95a6-02b2-46be-afeb-6c6b799e5799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:09.981883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b95a6-02b2-46be-afeb-6c6b799e5799 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:09.982200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b95a6-02b2-46be-afeb-6c6b799e5799 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:09.982483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b95a6-02b2-46be-afeb-6c6b799e5799 admin admin] PATH_INFO: `/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:09.983709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b95a6-02b2-46be-afeb-6c6b799e5799 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ccd5dcafb684ba88fe8fe109a2798be)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:10.009274 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b95a6-02b2-46be-afeb-6c6b799e5799 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:10.010844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 176/350] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:21:09 2021] GET /identity/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be => generated 344 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:10.016694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fad9e0-6508-4cc4-b0ac-7227c44495b7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:10.025614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fad9e0-6508-4cc4-b0ac-7227c44495b7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:10.030944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8c7e-01e4-47ff-bb3d-94983dc08141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:10.031775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8c7e-01e4-47ff-bb3d-94983dc08141 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:10.032057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8c7e-01e4-47ff-bb3d-94983dc08141 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:10.032550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8c7e-01e4-47ff-bb3d-94983dc08141 admin admin] PATH_INFO: `/v3/groups/043e5f1ebcb04a36aeb0d69e42deb363` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:10.033748 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd8c7e-01e4-47ff-bb3d-94983dc08141 admin admin] RBAC: Authorizing `identity:get_group(group_id=043e5f1ebcb04a36aeb0d69e42deb363)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:10.059764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd8c7e-01e4-47ff-bb3d-94983dc08141 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:10.061282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 175/351] 10.222.0.67 () {56 vars in 1201 bytes} [Thu Dec 16 14:21:10 2021] GET /identity/v3/groups/043e5f1ebcb04a36aeb0d69e42deb363 => generated 229 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:10.067557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b95a6-02b2-46be-afeb-6c6b799e5799 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:10.077357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b95a6-02b2-46be-afeb-6c6b799e5799 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:10.082207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2efd1c-f705-4311-a371-cffc2966b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:10.082798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efd1c-f705-4311-a371-cffc2966b6ea admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:10.083088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efd1c-f705-4311-a371-cffc2966b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:10.083369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efd1c-f705-4311-a371-cffc2966b6ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:10.084158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efd1c-f705-4311-a371-cffc2966b6ea admin admin] RBAC: Adding query filter params (group.id=043e5f1ebcb04a36aeb0d69e42deb363, role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=5ccd5dcafb684ba88fe8fe109a2798be) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:10.084462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efd1c-f705-4311-a371-cffc2966b6ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:10.109821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efd1c-f705-4311-a371-cffc2966b6ea admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:10.115966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 177/352] 10.222.0.67 () {56 vars in 1397 bytes} [Thu Dec 16 14:21:10 2021] GET /identity/v3/role_assignments?group.id=043e5f1ebcb04a36aeb0d69e42deb363&scope.project.id=5ccd5dcafb684ba88fe8fe109a2798be&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:12.140231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa4aef-bb01-41e7-a037-44a798926fbc None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:12.140711 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa4aef-bb01-41e7-a037-44a798926fbc None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:12.140806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa4aef-bb01-41e7-a037-44a798926fbc None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:12.142928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 176/353] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:12.150334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95b73e-f844-4693-8d8c-93ce856e9e31 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:12.150860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95b73e-f844-4693-8d8c-93ce856e9e31 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:12.150860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95b73e-f844-4693-8d8c-93ce856e9e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:12.180499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-cf95b73e-f844-4693-8d8c-93ce856e9e31 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:12.183737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-cf95b73e-f844-4693-8d8c-93ce856e9e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:12.194890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 178/354] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:12.219314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa4aef-bb01-41e7-a037-44a798926fbc None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:12.233887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa4aef-bb01-41e7-a037-44a798926fbc None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:12.239187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763caaa-b1db-4d0f-8965-2966db5b920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:12.240450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763caaa-b1db-4d0f-8965-2966db5b920d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:12.240877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763caaa-b1db-4d0f-8965-2966db5b920d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:12.241380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763caaa-b1db-4d0f-8965-2966db5b920d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:12.259391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763caaa-b1db-4d0f-8965-2966db5b920d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:12.295324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763caaa-b1db-4d0f-8965-2966db5b920d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:12.318541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-7763caaa-b1db-4d0f-8965-2966db5b920d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:12.320671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 177/355] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:12.331879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95b73e-f844-4693-8d8c-93ce856e9e31 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:12.341024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95b73e-f844-4693-8d8c-93ce856e9e31 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:12.346356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05d2a-e864-4871-bcff-f92dfc579b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:12.346965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05d2a-e864-4871-bcff-f92dfc579b0e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:12.347260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05d2a-e864-4871-bcff-f92dfc579b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:12.347531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05d2a-e864-4871-bcff-f92dfc579b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:12.348264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de05d2a-e864-4871-bcff-f92dfc579b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:12.348558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de05d2a-e864-4871-bcff-f92dfc579b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:12.374668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de05d2a-e864-4871-bcff-f92dfc579b0e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:12.388793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 179/356] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:12.394928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763caaa-b1db-4d0f-8965-2966db5b920d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:12.404723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763caaa-b1db-4d0f-8965-2966db5b920d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:12.409572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17514539-3f41-4c1f-8cec-0b3cf16a6792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:12.410208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514539-3f41-4c1f-8cec-0b3cf16a6792 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:12.410497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514539-3f41-4c1f-8cec-0b3cf16a6792 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:12.411865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514539-3f41-4c1f-8cec-0b3cf16a6792 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:12.414354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17514539-3f41-4c1f-8cec-0b3cf16a6792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:12.447990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-17514539-3f41-4c1f-8cec-0b3cf16a6792 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:12.447990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:21:12.447990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:21:12.449220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17514539-3f41-4c1f-8cec-0b3cf16a6792 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:12.477363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 178/357] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:21:12 2021] POST /identity/v3/users => generated 246 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:21:14.513371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84401564-68ef-477a-80d3-a974a0cadf8f None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:14.513917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84401564-68ef-477a-80d3-a974a0cadf8f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:14.513917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84401564-68ef-477a-80d3-a974a0cadf8f None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:14.515553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 180/358] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:14.521922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978398-284c-4ede-9e3d-cf78efb35e58 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:14.522522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978398-284c-4ede-9e3d-cf78efb35e58 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:14.522522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978398-284c-4ede-9e3d-cf78efb35e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:14.547923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c6978398-284c-4ede-9e3d-cf78efb35e58 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:14.549182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c6978398-284c-4ede-9e3d-cf78efb35e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:14.557592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 179/359] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:14.583619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84401564-68ef-477a-80d3-a974a0cadf8f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:14.600210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84401564-68ef-477a-80d3-a974a0cadf8f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:14.607147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5250c-d164-4bce-873e-c2d3c6f2ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:14.608224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5250c-d164-4bce-873e-c2d3c6f2ec4a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:14.608523 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5250c-d164-4bce-873e-c2d3c6f2ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:14.608804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5250c-d164-4bce-873e-c2d3c6f2ec4a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:14.624614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5250c-d164-4bce-873e-c2d3c6f2ec4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:14.631492 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-bfa5250c-d164-4bce-873e-c2d3c6f2ec4a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:21:14.632702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 181/360] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:21:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:14.639058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978398-284c-4ede-9e3d-cf78efb35e58 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:14.649368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978398-284c-4ede-9e3d-cf78efb35e58 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:14.656716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eddc3-ff8f-46f9-a246-61c1dd8c3496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:14.656716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eddc3-ff8f-46f9-a246-61c1dd8c3496 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:14.656716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eddc3-ff8f-46f9-a246-61c1dd8c3496 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:14.656716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eddc3-ff8f-46f9-a246-61c1dd8c3496 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:14.657374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eddc3-ff8f-46f9-a246-61c1dd8c3496 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:14.657681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eddc3-ff8f-46f9-a246-61c1dd8c3496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:14.684717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eddc3-ff8f-46f9-a246-61c1dd8c3496 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:14.699994 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 180/361] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:21:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:14.706539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5250c-d164-4bce-873e-c2d3c6f2ec4a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:14.717836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5250c-d164-4bce-873e-c2d3c6f2ec4a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:14.722981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926e212-2bf0-4a0e-9298-e63c8900eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:14.723971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926e212-2bf0-4a0e-9298-e63c8900eb32 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:14.724347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926e212-2bf0-4a0e-9298-e63c8900eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:14.724815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926e212-2bf0-4a0e-9298-e63c8900eb32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:14.741446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926e212-2bf0-4a0e-9298-e63c8900eb32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:14.773103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926e212-2bf0-4a0e-9298-e63c8900eb32 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:14.795009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-c926e212-2bf0-4a0e-9298-e63c8900eb32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:14.796615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 182/362] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:14.803457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eddc3-ff8f-46f9-a246-61c1dd8c3496 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:14.817309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eddc3-ff8f-46f9-a246-61c1dd8c3496 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:14.822960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:14.823901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:14.824187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:14.824465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:14.825159 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:14.825450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:14.866405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:14.866405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:21:14.866405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:21:14.867366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:14.884737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 181/363] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:21:14.892165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926e212-2bf0-4a0e-9298-e63c8900eb32 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:14.913068 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926e212-2bf0-4a0e-9298-e63c8900eb32 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:14.919486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a5435-61f5-4ea1-b3ad-2ab909279bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:14.920256 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a5435-61f5-4ea1-b3ad-2ab909279bbc admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:14.920539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a5435-61f5-4ea1-b3ad-2ab909279bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:14.920821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a5435-61f5-4ea1-b3ad-2ab909279bbc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:14.945138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a5435-61f5-4ea1-b3ad-2ab909279bbc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:14.976452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a5435-61f5-4ea1-b3ad-2ab909279bbc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:14.996268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-7f2a5435-61f5-4ea1-b3ad-2ab909279bbc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:21:14.997437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 183/364] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Dec 16 14:21:14 2021] GET /identity/v3/users/nova => generated 82 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:15.004020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:15.014024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023407f-8641-43a2-a9a3-6dd23811fdb9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:15.019071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:15.019683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:15.019966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:15.020238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:15.021035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:15.021340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:15.046360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:15.046360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:21:15.046360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:21:15.047424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:15.077285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 182/365] 10.222.0.67 () {56 vars in 1154 bytes} [Thu Dec 16 14:21:15 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:15.083267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a5435-61f5-4ea1-b3ad-2ab909279bbc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:15.093109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a5435-61f5-4ea1-b3ad-2ab909279bbc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:15.098412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2f864-f899-47ea-a140-40ed9d99994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:15.098979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2f864-f899-47ea-a140-40ed9d99994c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:15.099255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2f864-f899-47ea-a140-40ed9d99994c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:15.099525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2f864-f899-47ea-a140-40ed9d99994c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:15.107853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2f864-f899-47ea-a140-40ed9d99994c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:15.133574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2f864-f899-47ea-a140-40ed9d99994c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:15.143181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 184/366] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:15.148978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:15.159087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c86a0-38b6-4d99-9c94-282257efb93c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:15.163426 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116032a2-3e75-4135-b65b-0f2d337ae3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:15.164153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116032a2-3e75-4135-b65b-0f2d337ae3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:15.164433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116032a2-3e75-4135-b65b-0f2d337ae3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:15.164709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116032a2-3e75-4135-b65b-0f2d337ae3b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:15.177544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116032a2-3e75-4135-b65b-0f2d337ae3b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:15.203258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116032a2-3e75-4135-b65b-0f2d337ae3b5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:15.220991 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-116032a2-3e75-4135-b65b-0f2d337ae3b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:15.222124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 183/367] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:21:15.227909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2f864-f899-47ea-a140-40ed9d99994c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:15.237070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2f864-f899-47ea-a140-40ed9d99994c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:15.242171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15657bd4-0aae-4a5a-aff3-ea846df987c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:15.242769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15657bd4-0aae-4a5a-aff3-ea846df987c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:15.243044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15657bd4-0aae-4a5a-aff3-ea846df987c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:15.243315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15657bd4-0aae-4a5a-aff3-ea846df987c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:15.244008 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15657bd4-0aae-4a5a-aff3-ea846df987c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:15.244309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15657bd4-0aae-4a5a-aff3-ea846df987c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:15.269518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15657bd4-0aae-4a5a-aff3-ea846df987c3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:15.284157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 185/368] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:15.290030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116032a2-3e75-4135-b65b-0f2d337ae3b5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:15.300622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116032a2-3e75-4135-b65b-0f2d337ae3b5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:15.305019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd57ace-429c-4f0f-bec5-50126e4f06cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:15.305776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57ace-429c-4f0f-bec5-50126e4f06cd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:15.306081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57ace-429c-4f0f-bec5-50126e4f06cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:15.306358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57ace-429c-4f0f-bec5-50126e4f06cd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:15.317311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd57ace-429c-4f0f-bec5-50126e4f06cd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:15.343127 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd57ace-429c-4f0f-bec5-50126e4f06cd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:15.358524 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-4fd57ace-429c-4f0f-bec5-50126e4f06cd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:21:15.359810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 184/369] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:15.365748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15657bd4-0aae-4a5a-aff3-ea846df987c3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:15.375850 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15657bd4-0aae-4a5a-aff3-ea846df987c3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:15.380968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef85de9-95b7-40e5-a474-43a9c080a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:15.381559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef85de9-95b7-40e5-a474-43a9c080a0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:15.381838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef85de9-95b7-40e5-a474-43a9c080a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:15.382150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef85de9-95b7-40e5-a474-43a9c080a0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:15.382894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef85de9-95b7-40e5-a474-43a9c080a0a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:15.383188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef85de9-95b7-40e5-a474-43a9c080a0a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:15.408142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-eef85de9-95b7-40e5-a474-43a9c080a0a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:15.408142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:21:15.408142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:21:15.409270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef85de9-95b7-40e5-a474-43a9c080a0a3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:15.423298 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 186/370] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:21:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:15.429276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd57ace-429c-4f0f-bec5-50126e4f06cd admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:15.439569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd57ace-429c-4f0f-bec5-50126e4f06cd admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:15.444802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8dc0f-4def-4ad5-a21d-78d12ccf183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:15.445388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8dc0f-4def-4ad5-a21d-78d12ccf183c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:15.445653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8dc0f-4def-4ad5-a21d-78d12ccf183c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:15.445927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8dc0f-4def-4ad5-a21d-78d12ccf183c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:15.446741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8dc0f-4def-4ad5-a21d-78d12ccf183c admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f2bcc9f013f14ed89f5e94591f170b7b) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:15.447040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8dc0f-4def-4ad5-a21d-78d12ccf183c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:15.472454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8dc0f-4def-4ad5-a21d-78d12ccf183c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:15.478854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 185/371] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:21:15 2021] GET /identity/v3/role_assignments?user.id=f2bcc9f013f14ed89f5e94591f170b7b&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:17.471200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad8a41-0738-4076-8473-9d6a746f6ef6 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:17.471733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad8a41-0738-4076-8473-9d6a746f6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:17.471733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad8a41-0738-4076-8473-9d6a746f6ef6 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:17.473359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 187/372] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:17.478727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a74c7-7f52-49c6-9194-0c29fdfddec5 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:17.479153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a74c7-7f52-49c6-9194-0c29fdfddec5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:17.479260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a74c7-7f52-49c6-9194-0c29fdfddec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:17.503377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-434a74c7-7f52-49c6-9194-0c29fdfddec5 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:17.504534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-434a74c7-7f52-49c6-9194-0c29fdfddec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:17.511597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 186/373] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:17.533711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad8a41-0738-4076-8473-9d6a746f6ef6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:17.547779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad8a41-0738-4076-8473-9d6a746f6ef6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:17.552788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ce57e-f0b8-4faa-a8f1-f8af673adeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:17.553541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ce57e-f0b8-4faa-a8f1-f8af673adeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:17.553826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ce57e-f0b8-4faa-a8f1-f8af673adeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:17.554133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ce57e-f0b8-4faa-a8f1-f8af673adeb5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:17.566996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ce57e-f0b8-4faa-a8f1-f8af673adeb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:17.573514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-157ce57e-f0b8-4faa-a8f1-f8af673adeb5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:21:17.574738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 188/374] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:21:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:17.581447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a74c7-7f52-49c6-9194-0c29fdfddec5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:17.590742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a74c7-7f52-49c6-9194-0c29fdfddec5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:17.596067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2be72-b8ab-467b-946a-8d3f61c2851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:17.596666 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2be72-b8ab-467b-946a-8d3f61c2851f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:17.596953 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2be72-b8ab-467b-946a-8d3f61c2851f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:17.597236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2be72-b8ab-467b-946a-8d3f61c2851f admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:17.597951 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2be72-b8ab-467b-946a-8d3f61c2851f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:17.598288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2be72-b8ab-467b-946a-8d3f61c2851f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:17.623602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2be72-b8ab-467b-946a-8d3f61c2851f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:17.633331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 187/375] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:21:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:17.640104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ce57e-f0b8-4faa-a8f1-f8af673adeb5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:17.651322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ce57e-f0b8-4faa-a8f1-f8af673adeb5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:17.656547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b653-027d-4654-a133-8229b69b7d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:17.657773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b653-027d-4654-a133-8229b69b7d67 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:17.658084 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b653-027d-4654-a133-8229b69b7d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:17.658368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b653-027d-4654-a133-8229b69b7d67 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:17.670632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823b653-027d-4654-a133-8229b69b7d67 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:17.697146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823b653-027d-4654-a133-8229b69b7d67 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:17.716198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-d823b653-027d-4654-a133-8229b69b7d67 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:17.717316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 189/376] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:17.726947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2be72-b8ab-467b-946a-8d3f61c2851f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:17.737602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2be72-b8ab-467b-946a-8d3f61c2851f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:17.742984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ae734-06c4-4cdf-ae83-0b0436bc012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:17.743579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ae734-06c4-4cdf-ae83-0b0436bc012a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:17.743861 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ae734-06c4-4cdf-ae83-0b0436bc012a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:17.744134 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ae734-06c4-4cdf-ae83-0b0436bc012a admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:17.744833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ae734-06c4-4cdf-ae83-0b0436bc012a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:17.745146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ae734-06c4-4cdf-ae83-0b0436bc012a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:17.770608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ae734-06c4-4cdf-ae83-0b0436bc012a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:17.784511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 188/377] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:17.790300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b653-027d-4654-a133-8229b69b7d67 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:17.801007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b653-027d-4654-a133-8229b69b7d67 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:17.805326 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d6031-7f75-473d-8094-9a0f33e649fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:17.806095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d6031-7f75-473d-8094-9a0f33e649fb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:17.806383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d6031-7f75-473d-8094-9a0f33e649fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:17.806661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d6031-7f75-473d-8094-9a0f33e649fb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:17.820357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d6031-7f75-473d-8094-9a0f33e649fb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:17.847258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d6031-7f75-473d-8094-9a0f33e649fb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:17.866689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-7a2d6031-7f75-473d-8094-9a0f33e649fb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:21:17.867827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 190/378] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Dec 16 14:21:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:17.873764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ae734-06c4-4cdf-ae83-0b0436bc012a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:17.883832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ae734-06c4-4cdf-ae83-0b0436bc012a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:17.888999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96298f-cea3-4006-bb3d-f33da7d8ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:17.889590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96298f-cea3-4006-bb3d-f33da7d8ec83 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:17.889868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96298f-cea3-4006-bb3d-f33da7d8ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:17.890167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96298f-cea3-4006-bb3d-f33da7d8ec83 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:17.890992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96298f-cea3-4006-bb3d-f33da7d8ec83 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:17.891385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96298f-cea3-4006-bb3d-f33da7d8ec83 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:17.917645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96298f-cea3-4006-bb3d-f33da7d8ec83 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:18.032670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 189/379] 10.222.0.67 () {56 vars in 1154 bytes} [Thu Dec 16 14:21:17 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:18.038442 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d6031-7f75-473d-8094-9a0f33e649fb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:18.048929 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d6031-7f75-473d-8094-9a0f33e649fb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:18.053293 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ca4e0-5a1d-4887-a24e-2cc315c2b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:18.054019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca4e0-5a1d-4887-a24e-2cc315c2b262 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:18.054307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca4e0-5a1d-4887-a24e-2cc315c2b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:18.054582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca4e0-5a1d-4887-a24e-2cc315c2b262 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:18.068448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ca4e0-5a1d-4887-a24e-2cc315c2b262 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:18.093760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ca4e0-5a1d-4887-a24e-2cc315c2b262 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:18.111152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-4f5ca4e0-5a1d-4887-a24e-2cc315c2b262 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:18.112238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 191/380] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:18.117717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96298f-cea3-4006-bb3d-f33da7d8ec83 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:18.127894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96298f-cea3-4006-bb3d-f33da7d8ec83 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:18.132157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5a898-266e-400e-b59b-f3fbd6fabf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:18.132743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5a898-266e-400e-b59b-f3fbd6fabf53 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:18.133021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5a898-266e-400e-b59b-f3fbd6fabf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:18.133290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5a898-266e-400e-b59b-f3fbd6fabf53 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:18.134013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5a898-266e-400e-b59b-f3fbd6fabf53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:18.134316 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5a898-266e-400e-b59b-f3fbd6fabf53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:18.159669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5a898-266e-400e-b59b-f3fbd6fabf53 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:18.173627 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 190/381] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:18.179355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ca4e0-5a1d-4887-a24e-2cc315c2b262 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:18.190020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ca4e0-5a1d-4887-a24e-2cc315c2b262 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:18.195474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027c6aa-f20b-40b6-9da5-6009080542ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:18.196206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027c6aa-f20b-40b6-9da5-6009080542ce admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:18.196481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027c6aa-f20b-40b6-9da5-6009080542ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:18.196760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027c6aa-f20b-40b6-9da5-6009080542ce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:18.301811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027c6aa-f20b-40b6-9da5-6009080542ce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:18.327552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027c6aa-f20b-40b6-9da5-6009080542ce admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:18.342278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-3027c6aa-f20b-40b6-9da5-6009080542ce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:21:18.343407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 192/382] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:18.349373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5a898-266e-400e-b59b-f3fbd6fabf53 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:18.359417 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5a898-266e-400e-b59b-f3fbd6fabf53 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:18.364690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac453f60-03f7-4d48-b7e9-2fc5fe6c33cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:18.365314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453f60-03f7-4d48-b7e9-2fc5fe6c33cb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:18.365606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453f60-03f7-4d48-b7e9-2fc5fe6c33cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:18.365880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac453f60-03f7-4d48-b7e9-2fc5fe6c33cb admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:18.366698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac453f60-03f7-4d48-b7e9-2fc5fe6c33cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:18.366999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac453f60-03f7-4d48-b7e9-2fc5fe6c33cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:18.392445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-ac453f60-03f7-4d48-b7e9-2fc5fe6c33cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:18.392445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:21:18.392445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:21:18.393597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac453f60-03f7-4d48-b7e9-2fc5fe6c33cb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:18.407998 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 191/383] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:21:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:18.414038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027c6aa-f20b-40b6-9da5-6009080542ce admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:18.425003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027c6aa-f20b-40b6-9da5-6009080542ce admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:18.429346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a392cc-9259-4033-9e29-5c389081093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:18.430238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a392cc-9259-4033-9e29-5c389081093c admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:18.430495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a392cc-9259-4033-9e29-5c389081093c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:18.430767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a392cc-9259-4033-9e29-5c389081093c admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f2bcc9f013f14ed89f5e94591f170b7b/roles/26d42daa051b453488fbaac4330bd6ab` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:18.451029 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a392cc-9259-4033-9e29-5c389081093c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=f2bcc9f013f14ed89f5e94591f170b7b, role_id=26d42daa051b453488fbaac4330bd6ab)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:18.477071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a392cc-9259-4033-9e29-5c389081093c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:18.492731 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 193/384] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:21:18 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f2bcc9f013f14ed89f5e94591f170b7b/roles/26d42daa051b453488fbaac4330bd6ab => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:21:20.920448 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63558-7774-40bf-882e-e548e4057120 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:20.921390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63558-7774-40bf-882e-e548e4057120 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:20.921390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63558-7774-40bf-882e-e548e4057120 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:20.923157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 192/385] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:20.928693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e42d-e9a0-4d42-b926-dae21218bfa6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:20.929182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e42d-e9a0-4d42-b926-dae21218bfa6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:20.929301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e42d-e9a0-4d42-b926-dae21218bfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:20.958473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1510e42d-e9a0-4d42-b926-dae21218bfa6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:20.959626 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1510e42d-e9a0-4d42-b926-dae21218bfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:21.027326 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 194/386] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:21.051385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede63558-7774-40bf-882e-e548e4057120 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.065901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede63558-7774-40bf-882e-e548e4057120 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.070177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c7827-29e8-4abd-8aeb-111eec78fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.070919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c7827-29e8-4abd-8aeb-111eec78fcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.071205 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c7827-29e8-4abd-8aeb-111eec78fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.071490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c7827-29e8-4abd-8aeb-111eec78fcb2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.087167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c7827-29e8-4abd-8aeb-111eec78fcb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:21.107966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-7b7c7827-29e8-4abd-8aeb-111eec78fcb2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:21:21.112055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 193/387] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:21.117956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510e42d-e9a0-4d42-b926-dae21218bfa6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.127620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510e42d-e9a0-4d42-b926-dae21218bfa6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.132941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a23035-f872-40bb-949e-ceab6fff5121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.133545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a23035-f872-40bb-949e-ceab6fff5121 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.133827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a23035-f872-40bb-949e-ceab6fff5121 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.134146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a23035-f872-40bb-949e-ceab6fff5121 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.134892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a23035-f872-40bb-949e-ceab6fff5121 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:21.135170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a23035-f872-40bb-949e-ceab6fff5121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.160422 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a23035-f872-40bb-949e-ceab6fff5121 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.170145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 195/388] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:21.176271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c7827-29e8-4abd-8aeb-111eec78fcb2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.186293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c7827-29e8-4abd-8aeb-111eec78fcb2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.191130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204618f-6f7f-4543-981e-a855d2c04f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.191840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204618f-6f7f-4543-981e-a855d2c04f19 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.192147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204618f-6f7f-4543-981e-a855d2c04f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.192422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204618f-6f7f-4543-981e-a855d2c04f19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.204733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204618f-6f7f-4543-981e-a855d2c04f19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.230526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204618f-6f7f-4543-981e-a855d2c04f19 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.249859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-c204618f-6f7f-4543-981e-a855d2c04f19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:21.251232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 194/389] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:21.257169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a23035-f872-40bb-949e-ceab6fff5121 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.267215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a23035-f872-40bb-949e-ceab6fff5121 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.272176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022d311-c819-4be0-8f21-d5b6ad09309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.272797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d311-c819-4be0-8f21-d5b6ad09309e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.273080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d311-c819-4be0-8f21-d5b6ad09309e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.273354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d311-c819-4be0-8f21-d5b6ad09309e admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.274090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022d311-c819-4be0-8f21-d5b6ad09309e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:21.274397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022d311-c819-4be0-8f21-d5b6ad09309e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.300205 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022d311-c819-4be0-8f21-d5b6ad09309e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.314372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 196/390] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:21.320359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204618f-6f7f-4543-981e-a855d2c04f19 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.330509 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204618f-6f7f-4543-981e-a855d2c04f19 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.335099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d371e-1248-484c-8511-ce86fad549e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.335831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d371e-1248-484c-8511-ce86fad549e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.336107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d371e-1248-484c-8511-ce86fad549e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.336377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d371e-1248-484c-8511-ce86fad549e5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.349978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d371e-1248-484c-8511-ce86fad549e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.376165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d371e-1248-484c-8511-ce86fad549e5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.395148 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-219d371e-1248-484c-8511-ce86fad549e5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:21:21.396343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 195/391] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:21.403941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022d311-c819-4be0-8f21-d5b6ad09309e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.416034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022d311-c819-4be0-8f21-d5b6ad09309e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.420365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.421266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.421548 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.421823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.422929 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:21.423224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.447884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:21.447884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:21:21.447884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:21:21.448924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.479737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 197/392] 10.222.0.67 () {56 vars in 1154 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:21.486424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d371e-1248-484c-8511-ce86fad549e5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.496420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d371e-1248-484c-8511-ce86fad549e5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.501601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588054c0-cb02-4e37-872a-3d144bd11764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.502278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588054c0-cb02-4e37-872a-3d144bd11764 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.502566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588054c0-cb02-4e37-872a-3d144bd11764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.502849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588054c0-cb02-4e37-872a-3d144bd11764 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.511044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588054c0-cb02-4e37-872a-3d144bd11764 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.537157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588054c0-cb02-4e37-872a-3d144bd11764 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.546963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 196/393] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:21.553962 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.564385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63253427-6039-435f-8839-f767217a3db2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.568858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a9c52-8f88-4f77-9479-41d87370e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.569599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a9c52-8f88-4f77-9479-41d87370e291 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.569888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a9c52-8f88-4f77-9479-41d87370e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.570337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a9c52-8f88-4f77-9479-41d87370e291 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.585956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a9c52-8f88-4f77-9479-41d87370e291 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.615785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a9c52-8f88-4f77-9479-41d87370e291 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.635659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-d18a9c52-8f88-4f77-9479-41d87370e291 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:21.637065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 198/394] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:21.643856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588054c0-cb02-4e37-872a-3d144bd11764 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.653474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588054c0-cb02-4e37-872a-3d144bd11764 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.659009 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330184-9c68-4b58-80ca-40002ede9ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.659615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330184-9c68-4b58-80ca-40002ede9ecd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.659900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330184-9c68-4b58-80ca-40002ede9ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.660177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330184-9c68-4b58-80ca-40002ede9ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.660873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a330184-9c68-4b58-80ca-40002ede9ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:21.661178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a330184-9c68-4b58-80ca-40002ede9ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.687245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a330184-9c68-4b58-80ca-40002ede9ecd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.701578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 197/395] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:21.707468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a9c52-8f88-4f77-9479-41d87370e291 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.718477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a9c52-8f88-4f77-9479-41d87370e291 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.723824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56425-2b8c-4565-91cd-0e689cf3380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.724551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56425-2b8c-4565-91cd-0e689cf3380c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.724829 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56425-2b8c-4565-91cd-0e689cf3380c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.725081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de56425-2b8c-4565-91cd-0e689cf3380c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.735119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de56425-2b8c-4565-91cd-0e689cf3380c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.760538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de56425-2b8c-4565-91cd-0e689cf3380c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.779151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-0de56425-2b8c-4565-91cd-0e689cf3380c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:21:21.780316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 199/396] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:21.788683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330184-9c68-4b58-80ca-40002ede9ecd admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.799980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330184-9c68-4b58-80ca-40002ede9ecd admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.804976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d60de-219c-4f4e-8a92-cf41bf88f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.805571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d60de-219c-4f4e-8a92-cf41bf88f231 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.805858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d60de-219c-4f4e-8a92-cf41bf88f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.806167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d60de-219c-4f4e-8a92-cf41bf88f231 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.806921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d60de-219c-4f4e-8a92-cf41bf88f231 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:21.807221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d60de-219c-4f4e-8a92-cf41bf88f231 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.836206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d60de-219c-4f4e-8a92-cf41bf88f231 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.852025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 198/397] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:21.858302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56425-2b8c-4565-91cd-0e689cf3380c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:21.868632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de56425-2b8c-4565-91cd-0e689cf3380c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:21.872844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc4662-8e39-4f5c-8b86-ea8381f8b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:21.873473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc4662-8e39-4f5c-8b86-ea8381f8b5af admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:21.873756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc4662-8e39-4f5c-8b86-ea8381f8b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:21.874057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc4662-8e39-4f5c-8b86-ea8381f8b5af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:21.874886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc4662-8e39-4f5c-8b86-ea8381f8b5af admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f2bcc9f013f14ed89f5e94591f170b7b) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:21.875220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc4662-8e39-4f5c-8b86-ea8381f8b5af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:21.901619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc4662-8e39-4f5c-8b86-ea8381f8b5af admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:21.908915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 200/398] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:21:21 2021] GET /identity/v3/role_assignments?user.id=f2bcc9f013f14ed89f5e94591f170b7b&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:24.076928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15f028-3723-4bd5-8a51-23926fbc2220 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.077510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15f028-3723-4bd5-8a51-23926fbc2220 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.077510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15f028-3723-4bd5-8a51-23926fbc2220 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.079521 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 199/399] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:24.085737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e864-a986-4dfc-a457-e7a426b16723 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.086196 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e864-a986-4dfc-a457-e7a426b16723 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.086349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e864-a986-4dfc-a457-e7a426b16723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.116431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-8458e864-a986-4dfc-a457-e7a426b16723 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:24.118438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8458e864-a986-4dfc-a457-e7a426b16723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:24.131013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 201/400] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:24.157440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15f028-3723-4bd5-8a51-23926fbc2220 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.176984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15f028-3723-4bd5-8a51-23926fbc2220 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.183572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90920-2d84-4f59-a62c-004ccc4ffb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.184605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90920-2d84-4f59-a62c-004ccc4ffb2f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.184892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90920-2d84-4f59-a62c-004ccc4ffb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.185171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90920-2d84-4f59-a62c-004ccc4ffb2f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.203845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90920-2d84-4f59-a62c-004ccc4ffb2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:24.213628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-03f90920-2d84-4f59-a62c-004ccc4ffb2f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:21:24.215877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 200/401] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:24.223696 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e864-a986-4dfc-a457-e7a426b16723 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.234848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e864-a986-4dfc-a457-e7a426b16723 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.241024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed3ce-b0ae-450b-9007-e3828436b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.242086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed3ce-b0ae-450b-9007-e3828436b63a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.242594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed3ce-b0ae-450b-9007-e3828436b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.243096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed3ce-b0ae-450b-9007-e3828436b63a admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.244466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed3ce-b0ae-450b-9007-e3828436b63a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:24.244997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed3ce-b0ae-450b-9007-e3828436b63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:24.285660 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed3ce-b0ae-450b-9007-e3828436b63a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:24.297272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 202/402] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:24.303167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90920-2d84-4f59-a62c-004ccc4ffb2f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.313735 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90920-2d84-4f59-a62c-004ccc4ffb2f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.318537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e98fd8-8051-4b63-b8f6-cfb177d5fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.319274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e98fd8-8051-4b63-b8f6-cfb177d5fe6f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.319561 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e98fd8-8051-4b63-b8f6-cfb177d5fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.319845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e98fd8-8051-4b63-b8f6-cfb177d5fe6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.333081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e98fd8-8051-4b63-b8f6-cfb177d5fe6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:24.358884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e98fd8-8051-4b63-b8f6-cfb177d5fe6f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:24.379746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-47e98fd8-8051-4b63-b8f6-cfb177d5fe6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:24.380939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 201/403] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:21:24.387639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed3ce-b0ae-450b-9007-e3828436b63a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.412788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed3ce-b0ae-450b-9007-e3828436b63a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.421529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225665-3daf-4f4a-8aed-8867e30bc257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.423802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225665-3daf-4f4a-8aed-8867e30bc257 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.424644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225665-3daf-4f4a-8aed-8867e30bc257 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.425186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225665-3daf-4f4a-8aed-8867e30bc257 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.426702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32225665-3daf-4f4a-8aed-8867e30bc257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:24.427260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32225665-3daf-4f4a-8aed-8867e30bc257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:24.454049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32225665-3daf-4f4a-8aed-8867e30bc257 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:24.470605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 203/404] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:24.483596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e98fd8-8051-4b63-b8f6-cfb177d5fe6f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.494878 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e98fd8-8051-4b63-b8f6-cfb177d5fe6f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.499858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747ee33-44ae-41a8-a44c-d8a849b0c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.500969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747ee33-44ae-41a8-a44c-d8a849b0c5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.501459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747ee33-44ae-41a8-a44c-d8a849b0c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.501912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747ee33-44ae-41a8-a44c-d8a849b0c5b4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.521014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747ee33-44ae-41a8-a44c-d8a849b0c5b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:24.571400 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747ee33-44ae-41a8-a44c-d8a849b0c5b4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:24.594387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-8747ee33-44ae-41a8-a44c-d8a849b0c5b4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:21:24.595467 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 202/405] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/users/nova => generated 82 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:24.601260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225665-3daf-4f4a-8aed-8867e30bc257 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.611347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225665-3daf-4f4a-8aed-8867e30bc257 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.615529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e415-dc3e-4589-9ae4-80484132b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.616131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e415-dc3e-4589-9ae4-80484132b981 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.616416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e415-dc3e-4589-9ae4-80484132b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.616694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e415-dc3e-4589-9ae4-80484132b981 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.617504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40e415-dc3e-4589-9ae4-80484132b981 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:24.617808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40e415-dc3e-4589-9ae4-80484132b981 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:24.643997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40e415-dc3e-4589-9ae4-80484132b981 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:24.674089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 204/406] 10.222.0.67 () {56 vars in 1154 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:24.680051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747ee33-44ae-41a8-a44c-d8a849b0c5b4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.690511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747ee33-44ae-41a8-a44c-d8a849b0c5b4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.694525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f584041-f3c7-43b2-9271-03f76fad4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.695114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f584041-f3c7-43b2-9271-03f76fad4763 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.695396 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f584041-f3c7-43b2-9271-03f76fad4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.695712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f584041-f3c7-43b2-9271-03f76fad4763 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.704045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f584041-f3c7-43b2-9271-03f76fad4763 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:24.729540 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f584041-f3c7-43b2-9271-03f76fad4763 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:24.738689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 203/407] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:24.744508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e415-dc3e-4589-9ae4-80484132b981 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.765646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e415-dc3e-4589-9ae4-80484132b981 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.771839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a4c9d-257d-421b-aea9-eea9be510983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.772659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a4c9d-257d-421b-aea9-eea9be510983 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.772984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a4c9d-257d-421b-aea9-eea9be510983 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.773312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a4c9d-257d-421b-aea9-eea9be510983 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.788467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a4c9d-257d-421b-aea9-eea9be510983 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:24.827485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a4c9d-257d-421b-aea9-eea9be510983 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:24.848291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-4f9a4c9d-257d-421b-aea9-eea9be510983 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:24.849415 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 205/408] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:21:24.858381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f584041-f3c7-43b2-9271-03f76fad4763 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.869016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f584041-f3c7-43b2-9271-03f76fad4763 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.873004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eb1af-3dfb-4d84-ad2f-32fc4a169cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.873586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eb1af-3dfb-4d84-ad2f-32fc4a169cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.873864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eb1af-3dfb-4d84-ad2f-32fc4a169cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.874170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eb1af-3dfb-4d84-ad2f-32fc4a169cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.874856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eb1af-3dfb-4d84-ad2f-32fc4a169cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:24.875153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eb1af-3dfb-4d84-ad2f-32fc4a169cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:24.915304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eb1af-3dfb-4d84-ad2f-32fc4a169cf6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:24.933336 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 204/409] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:21:24.940394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a4c9d-257d-421b-aea9-eea9be510983 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:24.950099 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a4c9d-257d-421b-aea9-eea9be510983 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:24.954541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192bb0-8cc6-4fb7-9afc-d37e166a17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:24.955290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192bb0-8cc6-4fb7-9afc-d37e166a17b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:24.955576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192bb0-8cc6-4fb7-9afc-d37e166a17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:24.955854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192bb0-8cc6-4fb7-9afc-d37e166a17b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:24.965326 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a192bb0-8cc6-4fb7-9afc-d37e166a17b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:24.991193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a192bb0-8cc6-4fb7-9afc-d37e166a17b0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:25.005956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-4a192bb0-8cc6-4fb7-9afc-d37e166a17b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:21:25.007098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 206/410] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:25.012931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eb1af-3dfb-4d84-ad2f-32fc4a169cf6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:25.022828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eb1af-3dfb-4d84-ad2f-32fc4a169cf6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:25.026949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c637d17-9139-4689-b411-ea5450ebf183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:25.027549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637d17-9139-4689-b411-ea5450ebf183 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:25.027833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637d17-9139-4689-b411-ea5450ebf183 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:25.028113 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637d17-9139-4689-b411-ea5450ebf183 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:25.028870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c637d17-9139-4689-b411-ea5450ebf183 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:25.029173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c637d17-9139-4689-b411-ea5450ebf183 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:25.055253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c637d17-9139-4689-b411-ea5450ebf183 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:25.073805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 205/411] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:21:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:25.080283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192bb0-8cc6-4fb7-9afc-d37e166a17b0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:25.095609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192bb0-8cc6-4fb7-9afc-d37e166a17b0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:25.101673 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725350dd-171b-4ceb-934a-8f2e09e066df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:25.102656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725350dd-171b-4ceb-934a-8f2e09e066df admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:25.103168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725350dd-171b-4ceb-934a-8f2e09e066df admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:25.103674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725350dd-171b-4ceb-934a-8f2e09e066df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:25.105163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725350dd-171b-4ceb-934a-8f2e09e066df admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f2bcc9f013f14ed89f5e94591f170b7b) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:25.105715 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725350dd-171b-4ceb-934a-8f2e09e066df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:25.134591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725350dd-171b-4ceb-934a-8f2e09e066df admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:25.143859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 207/412] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:21:25 2021] GET /identity/v3/role_assignments?user.id=f2bcc9f013f14ed89f5e94591f170b7b&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 259 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:27.355379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b68656-d93c-49a4-8980-3dd749681b0e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.355946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b68656-d93c-49a4-8980-3dd749681b0e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.356360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b68656-d93c-49a4-8980-3dd749681b0e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.359526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 206/413] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:27.366133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf50c5-b9bf-4c04-85a2-dfcc3b16bb2f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.366651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf50c5-b9bf-4c04-85a2-dfcc3b16bb2f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.366651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf50c5-b9bf-4c04-85a2-dfcc3b16bb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.394191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-54bf50c5-b9bf-4c04-85a2-dfcc3b16bb2f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:27.395285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-54bf50c5-b9bf-4c04-85a2-dfcc3b16bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:27.403221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 208/414] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:27.429323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b68656-d93c-49a4-8980-3dd749681b0e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:27.442903 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b68656-d93c-49a4-8980-3dd749681b0e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:27.446762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3197d-f91a-44e1-a1b0-54b15c61d21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:27.447491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3197d-f91a-44e1-a1b0-54b15c61d21d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.447777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3197d-f91a-44e1-a1b0-54b15c61d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.448056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3197d-f91a-44e1-a1b0-54b15c61d21d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.460258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3197d-f91a-44e1-a1b0-54b15c61d21d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:27.466839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-0df3197d-f91a-44e1-a1b0-54b15c61d21d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:21:27.467970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 207/415] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:21:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:27.474756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf50c5-b9bf-4c04-85a2-dfcc3b16bb2f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:27.483907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf50c5-b9bf-4c04-85a2-dfcc3b16bb2f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:27.488583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d163f7-13c1-4fde-9c3a-f3bb04c26d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:27.489198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d163f7-13c1-4fde-9c3a-f3bb04c26d1c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.489475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d163f7-13c1-4fde-9c3a-f3bb04c26d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.489750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d163f7-13c1-4fde-9c3a-f3bb04c26d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.490521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d163f7-13c1-4fde-9c3a-f3bb04c26d1c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:27.490817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d163f7-13c1-4fde-9c3a-f3bb04c26d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:27.516443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d163f7-13c1-4fde-9c3a-f3bb04c26d1c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:27.525479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 209/416] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:21:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:27.531165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3197d-f91a-44e1-a1b0-54b15c61d21d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:27.541340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3197d-f91a-44e1-a1b0-54b15c61d21d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:27.546670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a8a35-69b1-4988-ab26-1bdbcf6ae377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:27.547592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8a35-69b1-4988-ab26-1bdbcf6ae377 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.547992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8a35-69b1-4988-ab26-1bdbcf6ae377 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.548358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8a35-69b1-4988-ab26-1bdbcf6ae377 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.560831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a8a35-69b1-4988-ab26-1bdbcf6ae377 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:27.587261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a8a35-69b1-4988-ab26-1bdbcf6ae377 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:27.606257 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-522a8a35-69b1-4988-ab26-1bdbcf6ae377 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:27.607390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 208/417] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:27.613481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d163f7-13c1-4fde-9c3a-f3bb04c26d1c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:27.623291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d163f7-13c1-4fde-9c3a-f3bb04c26d1c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:27.628458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f574f-bd81-446b-900e-cfdfb59624f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:27.629102 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f574f-bd81-446b-900e-cfdfb59624f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.629385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f574f-bd81-446b-900e-cfdfb59624f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.629665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f574f-bd81-446b-900e-cfdfb59624f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.630424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f574f-bd81-446b-900e-cfdfb59624f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:27.630749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f574f-bd81-446b-900e-cfdfb59624f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:27.657587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f574f-bd81-446b-900e-cfdfb59624f3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:27.671396 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 210/418] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:27.679145 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a8a35-69b1-4988-ab26-1bdbcf6ae377 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:27.689309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a8a35-69b1-4988-ab26-1bdbcf6ae377 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:27.693722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7458a8c-dbce-4a6e-936b-47244d66943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:27.694491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458a8c-dbce-4a6e-936b-47244d66943f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.694774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458a8c-dbce-4a6e-936b-47244d66943f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.695050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7458a8c-dbce-4a6e-936b-47244d66943f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.711784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7458a8c-dbce-4a6e-936b-47244d66943f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:27.740241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7458a8c-dbce-4a6e-936b-47244d66943f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:27.760368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-a7458a8c-dbce-4a6e-936b-47244d66943f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:21:27.761530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 209/419] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Dec 16 14:21:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:27.767841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f574f-bd81-446b-900e-cfdfb59624f3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:27.777689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f574f-bd81-446b-900e-cfdfb59624f3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:27.781917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7a5a4-f989-430f-a8ea-6dc9d218806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:27.783110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7a5a4-f989-430f-a8ea-6dc9d218806a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.783390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7a5a4-f989-430f-a8ea-6dc9d218806a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.783667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7a5a4-f989-430f-a8ea-6dc9d218806a admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.784466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7a5a4-f989-430f-a8ea-6dc9d218806a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:27.784767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7a5a4-f989-430f-a8ea-6dc9d218806a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:27.811177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7a5a4-f989-430f-a8ea-6dc9d218806a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:27.844755 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 211/420] 10.222.0.67 () {56 vars in 1154 bytes} [Thu Dec 16 14:21:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:27.854460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7458a8c-dbce-4a6e-936b-47244d66943f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:27.867263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7458a8c-dbce-4a6e-936b-47244d66943f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:27.872824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163869-ff6c-47d6-8df9-3c13b39faaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:27.874179 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163869-ff6c-47d6-8df9-3c13b39faaff admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.874697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163869-ff6c-47d6-8df9-3c13b39faaff admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.875081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163869-ff6c-47d6-8df9-3c13b39faaff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.889767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163869-ff6c-47d6-8df9-3c13b39faaff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:27.918734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163869-ff6c-47d6-8df9-3c13b39faaff admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:27.938044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-3c163869-ff6c-47d6-8df9-3c13b39faaff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:27.939319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 210/421] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:27.945875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7a5a4-f989-430f-a8ea-6dc9d218806a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:27.961314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7a5a4-f989-430f-a8ea-6dc9d218806a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:27.965699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a43f-bd63-4324-948e-c4110cc4cc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:27.966356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a43f-bd63-4324-948e-c4110cc4cc48 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:27.966644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a43f-bd63-4324-948e-c4110cc4cc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:27.966922 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a43f-bd63-4324-948e-c4110cc4cc48 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:27.967619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a43f-bd63-4324-948e-c4110cc4cc48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:27.967917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a43f-bd63-4324-948e-c4110cc4cc48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:28.000558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607a43f-bd63-4324-948e-c4110cc4cc48 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:28.020080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 212/422] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:28.026087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163869-ff6c-47d6-8df9-3c13b39faaff admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:28.037799 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163869-ff6c-47d6-8df9-3c13b39faaff admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:28.042365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb0963-1dc9-46f8-a3ab-90c7c36950d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:28.043225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0963-1dc9-46f8-a3ab-90c7c36950d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:28.043643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0963-1dc9-46f8-a3ab-90c7c36950d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:28.044053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0963-1dc9-46f8-a3ab-90c7c36950d4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:28.055890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb0963-1dc9-46f8-a3ab-90c7c36950d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:28.091137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb0963-1dc9-46f8-a3ab-90c7c36950d4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:28.109287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-48bb0963-1dc9-46f8-a3ab-90c7c36950d4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:21:28.111029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 211/423] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:21:28.118120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a43f-bd63-4324-948e-c4110cc4cc48 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:28.130164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607a43f-bd63-4324-948e-c4110cc4cc48 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:28.134932 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8754b-9829-4c1e-b6c9-e8e847377168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:28.135652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8754b-9829-4c1e-b6c9-e8e847377168 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:28.135996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8754b-9829-4c1e-b6c9-e8e847377168 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:28.136353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8754b-9829-4c1e-b6c9-e8e847377168 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:28.137305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8754b-9829-4c1e-b6c9-e8e847377168 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:28.137677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8754b-9829-4c1e-b6c9-e8e847377168 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:28.173304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8754b-9829-4c1e-b6c9-e8e847377168 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:28.189021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 213/424] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:21:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:28.195881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb0963-1dc9-46f8-a3ab-90c7c36950d4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:28.208392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb0963-1dc9-46f8-a3ab-90c7c36950d4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:28.213660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac927bd-6d7e-43c1-8bc4-c3d45a420be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:28.214862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac927bd-6d7e-43c1-8bc4-c3d45a420be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:28.215240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac927bd-6d7e-43c1-8bc4-c3d45a420be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:28.215608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac927bd-6d7e-43c1-8bc4-c3d45a420be9 admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f2bcc9f013f14ed89f5e94591f170b7b/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:28.217913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac927bd-6d7e-43c1-8bc4-c3d45a420be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=f2bcc9f013f14ed89f5e94591f170b7b, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:28.247744 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac927bd-6d7e-43c1-8bc4-c3d45a420be9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:28.264256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 212/425] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:21:28 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f2bcc9f013f14ed89f5e94591f170b7b/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:21:30.248651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b769a-5fc0-4a31-a156-9aafea93e75a None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.249220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b769a-5fc0-4a31-a156-9aafea93e75a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.249220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b769a-5fc0-4a31-a156-9aafea93e75a None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.251229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 214/426] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:30.257113 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71807755-320b-4a9f-a667-fa3d40d3e2ed None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.257560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71807755-320b-4a9f-a667-fa3d40d3e2ed None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.257667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71807755-320b-4a9f-a667-fa3d40d3e2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.281289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-71807755-320b-4a9f-a667-fa3d40d3e2ed None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:30.282564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-71807755-320b-4a9f-a667-fa3d40d3e2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:30.360964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 213/427] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:30.386891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b769a-5fc0-4a31-a156-9aafea93e75a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:30.402180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b769a-5fc0-4a31-a156-9aafea93e75a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:30.406266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428f36f-ff1c-4d5a-86b4-300fc02ffea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:30.407266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428f36f-ff1c-4d5a-86b4-300fc02ffea7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.407577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428f36f-ff1c-4d5a-86b4-300fc02ffea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.407938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428f36f-ff1c-4d5a-86b4-300fc02ffea7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.420661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428f36f-ff1c-4d5a-86b4-300fc02ffea7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:30.429784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-2428f36f-ff1c-4d5a-86b4-300fc02ffea7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:21:30.431015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 215/428] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:21:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:30.437206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71807755-320b-4a9f-a667-fa3d40d3e2ed None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:30.447186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71807755-320b-4a9f-a667-fa3d40d3e2ed None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:30.452339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdad35-0d7c-4055-ad07-5b7c16d19c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:30.452944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdad35-0d7c-4055-ad07-5b7c16d19c22 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.453226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdad35-0d7c-4055-ad07-5b7c16d19c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.453909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdad35-0d7c-4055-ad07-5b7c16d19c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.455043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdad35-0d7c-4055-ad07-5b7c16d19c22 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:30.455364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdad35-0d7c-4055-ad07-5b7c16d19c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:30.481382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdad35-0d7c-4055-ad07-5b7c16d19c22 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:30.491884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 214/429] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:21:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:30.497608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428f36f-ff1c-4d5a-86b4-300fc02ffea7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:30.508373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428f36f-ff1c-4d5a-86b4-300fc02ffea7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:30.512609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d22ab-8158-454f-bb3a-30f258084d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:30.515481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d22ab-8158-454f-bb3a-30f258084d72 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.515481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d22ab-8158-454f-bb3a-30f258084d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.515481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d22ab-8158-454f-bb3a-30f258084d72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.526965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d22ab-8158-454f-bb3a-30f258084d72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:30.553343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d22ab-8158-454f-bb3a-30f258084d72 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:30.572230 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-2b7d22ab-8158-454f-bb3a-30f258084d72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:30.573375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 216/430] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:30.579267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdad35-0d7c-4055-ad07-5b7c16d19c22 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:30.589409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdad35-0d7c-4055-ad07-5b7c16d19c22 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:30.594652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f93d4-fe01-44e7-ab6b-2b0447c1bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:30.595262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f93d4-fe01-44e7-ab6b-2b0447c1bca4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.595538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f93d4-fe01-44e7-ab6b-2b0447c1bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.595827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f93d4-fe01-44e7-ab6b-2b0447c1bca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.596506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f93d4-fe01-44e7-ab6b-2b0447c1bca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:30.596802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f93d4-fe01-44e7-ab6b-2b0447c1bca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:30.622077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f93d4-fe01-44e7-ab6b-2b0447c1bca4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:30.635680 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 215/431] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:30.641377 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d22ab-8158-454f-bb3a-30f258084d72 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:30.650848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d22ab-8158-454f-bb3a-30f258084d72 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:30.655274 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444384d-0e0a-4901-9af7-0796e40150a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:30.655968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444384d-0e0a-4901-9af7-0796e40150a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.656253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444384d-0e0a-4901-9af7-0796e40150a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.656597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444384d-0e0a-4901-9af7-0796e40150a9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.671767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444384d-0e0a-4901-9af7-0796e40150a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:30.697468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444384d-0e0a-4901-9af7-0796e40150a9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:30.716163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-b444384d-0e0a-4901-9af7-0796e40150a9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:21:30.717263 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 217/432] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Dec 16 14:21:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:30.723883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f93d4-fe01-44e7-ab6b-2b0447c1bca4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:30.733848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f93d4-fe01-44e7-ab6b-2b0447c1bca4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:30.739210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01749d-ac51-4132-a41b-83c8ab074885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:30.739835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01749d-ac51-4132-a41b-83c8ab074885 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.740114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01749d-ac51-4132-a41b-83c8ab074885 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.740392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01749d-ac51-4132-a41b-83c8ab074885 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.741184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01749d-ac51-4132-a41b-83c8ab074885 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:30.741477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01749d-ac51-4132-a41b-83c8ab074885 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:30.767170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01749d-ac51-4132-a41b-83c8ab074885 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:30.798507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 216/433] 10.222.0.67 () {56 vars in 1154 bytes} [Thu Dec 16 14:21:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:30.806496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444384d-0e0a-4901-9af7-0796e40150a9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:30.816251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444384d-0e0a-4901-9af7-0796e40150a9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:30.820345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11f45-441f-4182-9fe8-6635e36a98c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:30.820909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11f45-441f-4182-9fe8-6635e36a98c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.821191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11f45-441f-4182-9fe8-6635e36a98c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.821459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11f45-441f-4182-9fe8-6635e36a98c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.829660 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11f45-441f-4182-9fe8-6635e36a98c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:30.855251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab11f45-441f-4182-9fe8-6635e36a98c5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:30.865885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 218/434] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:30.871915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01749d-ac51-4132-a41b-83c8ab074885 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:30.881668 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01749d-ac51-4132-a41b-83c8ab074885 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:30.886168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb1faf-5c39-4d84-97ff-3006fd12a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:30.886891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb1faf-5c39-4d84-97ff-3006fd12a3ea admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.887171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb1faf-5c39-4d84-97ff-3006fd12a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.887424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb1faf-5c39-4d84-97ff-3006fd12a3ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.901277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb1faf-5c39-4d84-97ff-3006fd12a3ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:30.927252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb1faf-5c39-4d84-97ff-3006fd12a3ea admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:30.944830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-00fb1faf-5c39-4d84-97ff-3006fd12a3ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:30.946007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 217/435] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:30.951970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11f45-441f-4182-9fe8-6635e36a98c5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:30.960730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11f45-441f-4182-9fe8-6635e36a98c5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:30.965093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4faed2-6939-433d-9b31-aec95d59aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:30.965663 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4faed2-6939-433d-9b31-aec95d59aa89 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:30.965940 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4faed2-6939-433d-9b31-aec95d59aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:30.966241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4faed2-6939-433d-9b31-aec95d59aa89 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:30.966916 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4faed2-6939-433d-9b31-aec95d59aa89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:30.967206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4faed2-6939-433d-9b31-aec95d59aa89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:30.992632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4faed2-6939-433d-9b31-aec95d59aa89 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:31.005947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 219/436] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:31.011781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb1faf-5c39-4d84-97ff-3006fd12a3ea admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:31.022506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb1faf-5c39-4d84-97ff-3006fd12a3ea admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:31.027728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a184d4-709d-46e6-8820-99fff9f76eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:31.028463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a184d4-709d-46e6-8820-99fff9f76eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:31.028745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a184d4-709d-46e6-8820-99fff9f76eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:31.029014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a184d4-709d-46e6-8820-99fff9f76eb8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:31.039041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a184d4-709d-46e6-8820-99fff9f76eb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:31.065197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a184d4-709d-46e6-8820-99fff9f76eb8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:31.080153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-65a184d4-709d-46e6-8820-99fff9f76eb8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:21:31.081344 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 218/437] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:31.087572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4faed2-6939-433d-9b31-aec95d59aa89 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:31.103764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4faed2-6939-433d-9b31-aec95d59aa89 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:31.108184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd29a-4e08-454c-b982-1ee17287d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:31.108800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd29a-4e08-454c-b982-1ee17287d91e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:31.109082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd29a-4e08-454c-b982-1ee17287d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:31.109364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd29a-4e08-454c-b982-1ee17287d91e admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:31.110402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd29a-4e08-454c-b982-1ee17287d91e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:31.110722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd29a-4e08-454c-b982-1ee17287d91e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:31.136635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd29a-4e08-454c-b982-1ee17287d91e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:31.151069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 220/438] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:21:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:31.157887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a184d4-709d-46e6-8820-99fff9f76eb8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:31.167578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a184d4-709d-46e6-8820-99fff9f76eb8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:31.173111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932e08-d87e-4a05-b400-ae3e9386fb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:31.173705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932e08-d87e-4a05-b400-ae3e9386fb66 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:31.174009 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932e08-d87e-4a05-b400-ae3e9386fb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:31.174294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932e08-d87e-4a05-b400-ae3e9386fb66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:31.175083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932e08-d87e-4a05-b400-ae3e9386fb66 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f2bcc9f013f14ed89f5e94591f170b7b) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:31.175389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932e08-d87e-4a05-b400-ae3e9386fb66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:31.206421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932e08-d87e-4a05-b400-ae3e9386fb66 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:31.213458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 219/439] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:21:31 2021] GET /identity/v3/role_assignments?user.id=f2bcc9f013f14ed89f5e94591f170b7b&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:33.473036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3c452-b2c4-463f-9fbd-a21c00570705 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:33.473691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3c452-b2c4-463f-9fbd-a21c00570705 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:33.473691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3c452-b2c4-463f-9fbd-a21c00570705 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:33.475321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 221/440] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:21:33.483194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aadd7-b249-4d04-a3dd-14b61ee8d5ce None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:33.483963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aadd7-b249-4d04-a3dd-14b61ee8d5ce None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:33.483963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aadd7-b249-4d04-a3dd-14b61ee8d5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:33.513195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c15aadd7-b249-4d04-a3dd-14b61ee8d5ce None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:33.514743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c15aadd7-b249-4d04-a3dd-14b61ee8d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:33.523943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 220/441] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:33.551481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3c452-b2c4-463f-9fbd-a21c00570705 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:33.568912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3c452-b2c4-463f-9fbd-a21c00570705 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:33.574525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:33.575384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:33.575732 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:33.576113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:33.576834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:33.602154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:33.602154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:21:33.602154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:21:33.603201 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:33.616725 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 16 14:21:33.617910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 222/442] 10.222.0.67 () {56 vars in 1153 bytes} [Thu Dec 16 14:21:33 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:21:33.624193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aadd7-b249-4d04-a3dd-14b61ee8d5ce None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:33.634020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aadd7-b249-4d04-a3dd-14b61ee8d5ce None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:33.638084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9f2b1-2732-49bf-abff-adc868729b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:33.638687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9f2b1-2732-49bf-abff-adc868729b70 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:33.638963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9f2b1-2732-49bf-abff-adc868729b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:33.639241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9f2b1-2732-49bf-abff-adc868729b70 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:33.639946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9f2b1-2732-49bf-abff-adc868729b70 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:33.640335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9f2b1-2732-49bf-abff-adc868729b70 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:33.665617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-f1c9f2b1-2732-49bf-abff-adc868729b70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:33.665617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:21:33.665617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:21:33.666591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9f2b1-2732-49bf-abff-adc868729b70 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:33.672098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 221/443] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:21:33 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:33.678423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:33.688393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e480cb-309e-4f8a-b6a8-fec1817a98eb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:33.692877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f368237-c695-43fd-b3d6-b892e0aae2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:33.693475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f368237-c695-43fd-b3d6-b892e0aae2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:33.693762 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f368237-c695-43fd-b3d6-b892e0aae2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:33.694072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f368237-c695-43fd-b3d6-b892e0aae2d8 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:33.694775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f368237-c695-43fd-b3d6-b892e0aae2d8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:33.695076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f368237-c695-43fd-b3d6-b892e0aae2d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:33.719867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-9f368237-c695-43fd-b3d6-b892e0aae2d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:33.719867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:21:33.719867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:21:33.720773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f368237-c695-43fd-b3d6-b892e0aae2d8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:33.726522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 223/444] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:21:33 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:36.024407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59464e4-05c6-4dd6-8e24-1953791a6f83 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:36.024992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59464e4-05c6-4dd6-8e24-1953791a6f83 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:36.024992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59464e4-05c6-4dd6-8e24-1953791a6f83 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:36.026713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 222/445] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:36.032353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d33c6-798c-4be7-96ee-8ff667b7acf4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:36.032881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d33c6-798c-4be7-96ee-8ff667b7acf4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:36.032881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d33c6-798c-4be7-96ee-8ff667b7acf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:36.056874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a43d33c6-798c-4be7-96ee-8ff667b7acf4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:36.058024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a43d33c6-798c-4be7-96ee-8ff667b7acf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:36.065314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 224/446] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:36.088083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59464e4-05c6-4dd6-8e24-1953791a6f83 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:36.101605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59464e4-05c6-4dd6-8e24-1953791a6f83 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:36.106367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbad7a1-e24a-4aba-915a-051fd2c9f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:36.106965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbad7a1-e24a-4aba-915a-051fd2c9f680 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:36.107242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbad7a1-e24a-4aba-915a-051fd2c9f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:36.107512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbad7a1-e24a-4aba-915a-051fd2c9f680 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:36.108203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbad7a1-e24a-4aba-915a-051fd2c9f680 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:36.133304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-bfbad7a1-e24a-4aba-915a-051fd2c9f680 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:36.133304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:21:36.133304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:21:36.134216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbad7a1-e24a-4aba-915a-051fd2c9f680 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:36.150286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 223/447] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:21:36 2021] POST /identity/v3/services => generated 269 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:21:38.240795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe1af-2abb-495f-8f5e-bc50ad24dd85 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:38.241360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe1af-2abb-495f-8f5e-bc50ad24dd85 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:38.241360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe1af-2abb-495f-8f5e-bc50ad24dd85 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:38.243067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 225/448] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:38.248461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f260c0-96fe-457a-992f-73f4e10c34ec None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:38.248940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f260c0-96fe-457a-992f-73f4e10c34ec None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:38.249029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f260c0-96fe-457a-992f-73f4e10c34ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:38.274964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-37f260c0-96fe-457a-992f-73f4e10c34ec None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:38.276211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-37f260c0-96fe-457a-992f-73f4e10c34ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:38.294430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 224/449] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:38 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:38.318619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe1af-2abb-495f-8f5e-bc50ad24dd85 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:38.331748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe1af-2abb-495f-8f5e-bc50ad24dd85 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:38.337024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24d45f-955d-40cc-89c1-3017ba412a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:38.338069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24d45f-955d-40cc-89c1-3017ba412a73 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:38.338480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24d45f-955d-40cc-89c1-3017ba412a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:38.338953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24d45f-955d-40cc-89c1-3017ba412a73 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:38.340211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24d45f-955d-40cc-89c1-3017ba412a73 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:38.376905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24d45f-955d-40cc-89c1-3017ba412a73 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:38.389004 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-db24d45f-955d-40cc-89c1-3017ba412a73 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 16 14:21:38.390193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 226/450] 10.222.0.67 () {56 vars in 1153 bytes} [Thu Dec 16 14:21:38 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:38.396528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f260c0-96fe-457a-992f-73f4e10c34ec None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:38.405527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f260c0-96fe-457a-992f-73f4e10c34ec None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:38.412289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586655-29db-4f0a-bf7e-76dacffb7e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:38.412890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586655-29db-4f0a-bf7e-76dacffb7e29 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:38.413617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586655-29db-4f0a-bf7e-76dacffb7e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:38.413617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586655-29db-4f0a-bf7e-76dacffb7e29 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:38.414146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c586655-29db-4f0a-bf7e-76dacffb7e29 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:38.414441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c586655-29db-4f0a-bf7e-76dacffb7e29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:38.443174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c586655-29db-4f0a-bf7e-76dacffb7e29 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:38.448174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 225/451] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:21:38 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:38.454247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24d45f-955d-40cc-89c1-3017ba412a73 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:38.464284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24d45f-955d-40cc-89c1-3017ba412a73 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:38.469238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd2682-85bf-45c8-9fb2-8c4585d25bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:38.469865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd2682-85bf-45c8-9fb2-8c4585d25bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:38.470196 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd2682-85bf-45c8-9fb2-8c4585d25bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:38.470472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd2682-85bf-45c8-9fb2-8c4585d25bc1 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:38.471164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd2682-85bf-45c8-9fb2-8c4585d25bc1 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:38.471467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd2682-85bf-45c8-9fb2-8c4585d25bc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:38.496749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd2682-85bf-45c8-9fb2-8c4585d25bc1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:38.501774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 227/452] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:21:38 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:38.507506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586655-29db-4f0a-bf7e-76dacffb7e29 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:38.517376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586655-29db-4f0a-bf7e-76dacffb7e29 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:38.522437 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7449d-6efc-44d3-ad96-b8fa1a88bfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:38.523014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7449d-6efc-44d3-ad96-b8fa1a88bfec admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:38.523299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7449d-6efc-44d3-ad96-b8fa1a88bfec admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:38.523577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7449d-6efc-44d3-ad96-b8fa1a88bfec admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:38.524324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7449d-6efc-44d3-ad96-b8fa1a88bfec admin admin] RBAC: Adding query filter params (interface=public, service_id=b79b42318fcf4f1f9937a44d19adf5f3, region_id=RegionOne) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:38.524626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7449d-6efc-44d3-ad96-b8fa1a88bfec admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:38.549923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-f7e7449d-6efc-44d3-ad96-b8fa1a88bfec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:38.549923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:21:38.549923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:21:38.550823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7449d-6efc-44d3-ad96-b8fa1a88bfec admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:38.556928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 226/453] 10.222.0.67 () {56 vars in 1272 bytes} [Thu Dec 16 14:21:38 2021] GET /identity/v3/endpoints?service_id=b79b42318fcf4f1f9937a44d19adf5f3&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:38.562412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd2682-85bf-45c8-9fb2-8c4585d25bc1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:38.572401 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd2682-85bf-45c8-9fb2-8c4585d25bc1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:38.577280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129cfa-2933-423a-ae49-ccfa5f768611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:38.577865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129cfa-2933-423a-ae49-ccfa5f768611 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:38.578177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129cfa-2933-423a-ae49-ccfa5f768611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:38.578459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129cfa-2933-423a-ae49-ccfa5f768611 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:38.579151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6129cfa-2933-423a-ae49-ccfa5f768611 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:38.604328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6129cfa-2933-423a-ae49-ccfa5f768611 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:38.609382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 228/454] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:21:38 2021] GET /identity/v3/services => generated 562 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:40.625098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947b108-5679-4f4c-ba29-8661ba75ed38 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:40.625723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947b108-5679-4f4c-ba29-8661ba75ed38 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:40.626013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947b108-5679-4f4c-ba29-8661ba75ed38 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:40.627765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 227/455] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:40.633286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d6925-5d9a-4bd0-9c3f-07ec60fd3d11 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:40.633711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d6925-5d9a-4bd0-9c3f-07ec60fd3d11 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:40.633841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d6925-5d9a-4bd0-9c3f-07ec60fd3d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:40.657922 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d16d6925-5d9a-4bd0-9c3f-07ec60fd3d11 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:40.659121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d16d6925-5d9a-4bd0-9c3f-07ec60fd3d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:40.667202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 229/456] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:40 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:40.689621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947b108-5679-4f4c-ba29-8661ba75ed38 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:40.703139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947b108-5679-4f4c-ba29-8661ba75ed38 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:40.708029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:40.708764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:40.709060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:40.709337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:40.709953 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:40.734731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:40.734731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:21:40.734731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:21:40.735726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:40.747624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 16 14:21:40.748720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 228/457] 10.222.0.67 () {56 vars in 1153 bytes} [Thu Dec 16 14:21:40 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:40.755527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d6925-5d9a-4bd0-9c3f-07ec60fd3d11 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:40.764632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d6925-5d9a-4bd0-9c3f-07ec60fd3d11 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:40.770014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d82de-c8e4-491e-bb73-11e49564f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:40.770632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d82de-c8e4-491e-bb73-11e49564f7de admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:40.770910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d82de-c8e4-491e-bb73-11e49564f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:40.771185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d82de-c8e4-491e-bb73-11e49564f7de admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:40.771858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d82de-c8e4-491e-bb73-11e49564f7de admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:40.772154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d82de-c8e4-491e-bb73-11e49564f7de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:40.798027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d82de-c8e4-491e-bb73-11e49564f7de admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:40.803383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 230/458] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:21:40 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:40.809386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:40.819717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a30f2-e0e8-4ea8-bd57-9a5d5949258f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:40.825070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05c02a-e3d2-4a73-a56a-f1363cbed73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:40.825656 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c02a-e3d2-4a73-a56a-f1363cbed73b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:40.825932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c02a-e3d2-4a73-a56a-f1363cbed73b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:40.826247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c02a-e3d2-4a73-a56a-f1363cbed73b admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:40.826911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05c02a-e3d2-4a73-a56a-f1363cbed73b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:40.827206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05c02a-e3d2-4a73-a56a-f1363cbed73b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:40.857919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05c02a-e3d2-4a73-a56a-f1363cbed73b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:40.863866 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 229/459] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:21:40 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:40.869896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d82de-c8e4-491e-bb73-11e49564f7de admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:40.880630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d82de-c8e4-491e-bb73-11e49564f7de admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:40.885554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d073c38-109b-4725-8430-0c8234d65d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:40.886172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d073c38-109b-4725-8430-0c8234d65d3a admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:40.886450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d073c38-109b-4725-8430-0c8234d65d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:40.886719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d073c38-109b-4725-8430-0c8234d65d3a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:40.887416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d073c38-109b-4725-8430-0c8234d65d3a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:40.912314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-4d073c38-109b-4725-8430-0c8234d65d3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:40.912314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:21:40.912314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:21:40.913201 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d073c38-109b-4725-8430-0c8234d65d3a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:40.937010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 231/460] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:21:40 2021] POST /identity/v3/endpoints => generated 347 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:21:43.043529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c864c-35e7-4c3a-b613-c2c58cd12132 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:43.044160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c864c-35e7-4c3a-b613-c2c58cd12132 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:43.044160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c864c-35e7-4c3a-b613-c2c58cd12132 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:43.045804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 230/461] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:43.051528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23fc38-eb60-4691-b61a-94ecad35db0d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:43.051987 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23fc38-eb60-4691-b61a-94ecad35db0d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:43.052088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23fc38-eb60-4691-b61a-94ecad35db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:43.075361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-8e23fc38-eb60-4691-b61a-94ecad35db0d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:43.076556 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8e23fc38-eb60-4691-b61a-94ecad35db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:43.099806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 232/462] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:43 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:43.137027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c864c-35e7-4c3a-b613-c2c58cd12132 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:43.157537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c864c-35e7-4c3a-b613-c2c58cd12132 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:43.163443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab9593-c18d-4bbc-927c-0164673cf9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:43.164160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab9593-c18d-4bbc-927c-0164673cf9ad admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:43.164471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab9593-c18d-4bbc-927c-0164673cf9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:43.164785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab9593-c18d-4bbc-927c-0164673cf9ad admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:43.165446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab9593-c18d-4bbc-927c-0164673cf9ad admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:43.191097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab9593-c18d-4bbc-927c-0164673cf9ad admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:43.202221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-b8ab9593-c18d-4bbc-927c-0164673cf9ad admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 16 14:21:43.203348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 231/463] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:43 2021] GET /identity/v3/services/compute => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:43.209459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23fc38-eb60-4691-b61a-94ecad35db0d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:43.218295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23fc38-eb60-4691-b61a-94ecad35db0d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:43.222867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1187b88-d202-45ac-8ad9-892a109701e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:43.223454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1187b88-d202-45ac-8ad9-892a109701e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:43.223730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1187b88-d202-45ac-8ad9-892a109701e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:43.224003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1187b88-d202-45ac-8ad9-892a109701e8 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:43.224684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1187b88-d202-45ac-8ad9-892a109701e8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:43.225002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1187b88-d202-45ac-8ad9-892a109701e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:43.250347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1187b88-d202-45ac-8ad9-892a109701e8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:43.255364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 233/464] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:21:43 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:43.261173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab9593-c18d-4bbc-927c-0164673cf9ad admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:43.272422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab9593-c18d-4bbc-927c-0164673cf9ad admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:43.277716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc96e5-fbe9-4287-9df1-ec62ac74d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:43.278342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc96e5-fbe9-4287-9df1-ec62ac74d9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:43.278615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc96e5-fbe9-4287-9df1-ec62ac74d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:43.278885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc96e5-fbe9-4287-9df1-ec62ac74d9a4 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:43.279546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc96e5-fbe9-4287-9df1-ec62ac74d9a4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:43.279843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc96e5-fbe9-4287-9df1-ec62ac74d9a4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:43.305173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc96e5-fbe9-4287-9df1-ec62ac74d9a4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:43.310166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 232/465] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:21:43 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:45.381874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176279c-40e3-4863-bb89-5c26a1546dc1 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:45.382828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176279c-40e3-4863-bb89-5c26a1546dc1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:45.383824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176279c-40e3-4863-bb89-5c26a1546dc1 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:45.388669 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 234/466] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:45 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:45.394927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe8de-0c7e-4166-9d06-6dd84190bccf None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:45.395463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe8de-0c7e-4166-9d06-6dd84190bccf None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:45.395463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe8de-0c7e-4166-9d06-6dd84190bccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:45.426067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e2dfe8de-0c7e-4166-9d06-6dd84190bccf None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:45.427252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e2dfe8de-0c7e-4166-9d06-6dd84190bccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:45.434903 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 233/467] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:45 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:45.475724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176279c-40e3-4863-bb89-5c26a1546dc1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:45.497621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176279c-40e3-4863-bb89-5c26a1546dc1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:45.504807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781c160-0783-4231-b657-78d0863d0d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:45.505888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781c160-0783-4231-b657-78d0863d0d67 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:45.506345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781c160-0783-4231-b657-78d0863d0d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:45.506822 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781c160-0783-4231-b657-78d0863d0d67 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:45.508025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781c160-0783-4231-b657-78d0863d0d67 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:45.570545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-1781c160-0783-4231-b657-78d0863d0d67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:45.570545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:21:45.570545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:21:45.572540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781c160-0783-4231-b657-78d0863d0d67 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:45.603874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 235/468] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:21:45 2021] POST /identity/v3/services => generated 242 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:21:47.744172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf004-a3f3-409f-8bef-c7ce278783b6 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:47.744850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf004-a3f3-409f-8bef-c7ce278783b6 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:47.745385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf004-a3f3-409f-8bef-c7ce278783b6 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:47.748391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 234/469] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:47 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:47.757793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583b6c7-b8ba-4b3f-8371-8cb85e3bb19b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:47.758353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583b6c7-b8ba-4b3f-8371-8cb85e3bb19b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:47.758791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583b6c7-b8ba-4b3f-8371-8cb85e3bb19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:47.799407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a583b6c7-b8ba-4b3f-8371-8cb85e3bb19b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:47.801379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a583b6c7-b8ba-4b3f-8371-8cb85e3bb19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:47.829277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 236/470] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:47 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:47.854643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf004-a3f3-409f-8bef-c7ce278783b6 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:47.869104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf004-a3f3-409f-8bef-c7ce278783b6 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:47.873392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446c232-1762-4bad-81fa-405a7aac2027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:47.874368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c232-1762-4bad-81fa-405a7aac2027 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:47.874652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c232-1762-4bad-81fa-405a7aac2027 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:47.874926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c232-1762-4bad-81fa-405a7aac2027 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:47.875578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446c232-1762-4bad-81fa-405a7aac2027 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:47.901132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446c232-1762-4bad-81fa-405a7aac2027 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:47.912721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-6446c232-1762-4bad-81fa-405a7aac2027 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 16 14:21:47.913874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 235/471] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:47 2021] GET /identity/v3/services/compute => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:47.920075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583b6c7-b8ba-4b3f-8371-8cb85e3bb19b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:47.931798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583b6c7-b8ba-4b3f-8371-8cb85e3bb19b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:47.936353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c468-f6d9-4970-9bf5-9487ad8e5d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:47.936961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c468-f6d9-4970-9bf5-9487ad8e5d71 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:47.937232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c468-f6d9-4970-9bf5-9487ad8e5d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:47.937512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c468-f6d9-4970-9bf5-9487ad8e5d71 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:47.938462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c468-f6d9-4970-9bf5-9487ad8e5d71 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:47.938770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c468-f6d9-4970-9bf5-9487ad8e5d71 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:47.964237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c468-f6d9-4970-9bf5-9487ad8e5d71 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:47.969507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 237/472] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:21:47 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:47.976358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446c232-1762-4bad-81fa-405a7aac2027 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:47.992144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446c232-1762-4bad-81fa-405a7aac2027 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:47.997317 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e8e6b-fd67-49e2-87c6-a810dab3b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:47.997849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e8e6b-fd67-49e2-87c6-a810dab3b24d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:47.998142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e8e6b-fd67-49e2-87c6-a810dab3b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:47.998444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e8e6b-fd67-49e2-87c6-a810dab3b24d admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:47.999120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e8e6b-fd67-49e2-87c6-a810dab3b24d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:47.999409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e8e6b-fd67-49e2-87c6-a810dab3b24d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:48.024913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e8e6b-fd67-49e2-87c6-a810dab3b24d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:48.030793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 236/473] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:21:47 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:48.036982 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c468-f6d9-4970-9bf5-9487ad8e5d71 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:48.047365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c468-f6d9-4970-9bf5-9487ad8e5d71 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:48.051839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596bc36-6581-4b36-955c-b05fe2b7851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:48.052433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596bc36-6581-4b36-955c-b05fe2b7851f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:48.052712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596bc36-6581-4b36-955c-b05fe2b7851f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:48.052983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596bc36-6581-4b36-955c-b05fe2b7851f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:48.053730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596bc36-6581-4b36-955c-b05fe2b7851f admin admin] RBAC: Adding query filter params (interface=public, service_id=5e48a647043448669eb3112564b46808, region_id=RegionOne) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:48.054057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596bc36-6581-4b36-955c-b05fe2b7851f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:48.079067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-1596bc36-6581-4b36-955c-b05fe2b7851f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:48.079067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:21:48.079067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:21:48.079993 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596bc36-6581-4b36-955c-b05fe2b7851f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:48.086463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 238/474] 10.222.0.67 () {56 vars in 1272 bytes} [Thu Dec 16 14:21:48 2021] GET /identity/v3/endpoints?service_id=5e48a647043448669eb3112564b46808&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:48.092393 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e8e6b-fd67-49e2-87c6-a810dab3b24d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:48.106209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e8e6b-fd67-49e2-87c6-a810dab3b24d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:48.112034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11205d0-9a6e-42e0-b320-ca5aada6af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:48.112650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11205d0-9a6e-42e0-b320-ca5aada6af77 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:48.112934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11205d0-9a6e-42e0-b320-ca5aada6af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:48.113229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11205d0-9a6e-42e0-b320-ca5aada6af77 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:48.114508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11205d0-9a6e-42e0-b320-ca5aada6af77 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:48.140895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11205d0-9a6e-42e0-b320-ca5aada6af77 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:48.147405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 237/475] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:21:48 2021] GET /identity/v3/services => generated 792 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:50.138789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918392be-f558-4bc2-bb04-c91cdff6585d None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:50.139414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918392be-f558-4bc2-bb04-c91cdff6585d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:50.139414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918392be-f558-4bc2-bb04-c91cdff6585d None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:50.141103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 239/476] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:50.147357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a2fd3-178e-4cf9-8f38-8ec91d925afd None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:50.147791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a2fd3-178e-4cf9-8f38-8ec91d925afd None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:50.147928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a2fd3-178e-4cf9-8f38-8ec91d925afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:50.172620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-7a6a2fd3-178e-4cf9-8f38-8ec91d925afd None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:50.173943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7a6a2fd3-178e-4cf9-8f38-8ec91d925afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:50.181183 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 238/477] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:50 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:50.205000 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918392be-f558-4bc2-bb04-c91cdff6585d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:50.217137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918392be-f558-4bc2-bb04-c91cdff6585d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:50.221302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bee0ae-36d1-46cb-b554-474afd6d7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:50.222027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bee0ae-36d1-46cb-b554-474afd6d7c02 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:50.222338 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bee0ae-36d1-46cb-b554-474afd6d7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:50.222603 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bee0ae-36d1-46cb-b554-474afd6d7c02 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:50.223245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bee0ae-36d1-46cb-b554-474afd6d7c02 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:50.248855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bee0ae-36d1-46cb-b554-474afd6d7c02 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:50.261105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-f3bee0ae-36d1-46cb-b554-474afd6d7c02 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 16 14:21:50.262440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 240/478] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:50 2021] GET /identity/v3/services/compute => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:50.268908 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a2fd3-178e-4cf9-8f38-8ec91d925afd None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:50.278018 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a2fd3-178e-4cf9-8f38-8ec91d925afd None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:50.283254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d96c23-5743-462e-a496-6f3d91c584e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:50.283853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d96c23-5743-462e-a496-6f3d91c584e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:50.284148 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d96c23-5743-462e-a496-6f3d91c584e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:50.284426 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d96c23-5743-462e-a496-6f3d91c584e5 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:50.285110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d96c23-5743-462e-a496-6f3d91c584e5 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:50.285405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d96c23-5743-462e-a496-6f3d91c584e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:50.315826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d96c23-5743-462e-a496-6f3d91c584e5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:50.321524 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 239/479] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:21:50 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:21:50.327726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bee0ae-36d1-46cb-b554-474afd6d7c02 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:50.343132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bee0ae-36d1-46cb-b554-474afd6d7c02 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:50.353753 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1689e1-5590-4b06-ae14-5eae1bb294d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:50.354828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1689e1-5590-4b06-ae14-5eae1bb294d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:50.355304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1689e1-5590-4b06-ae14-5eae1bb294d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:50.355790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1689e1-5590-4b06-ae14-5eae1bb294d1 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:50.356967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1689e1-5590-4b06-ae14-5eae1bb294d1 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:50.357476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1689e1-5590-4b06-ae14-5eae1bb294d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:50.402117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1689e1-5590-4b06-ae14-5eae1bb294d1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:50.407726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 241/480] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:21:50 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:50.413539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d96c23-5743-462e-a496-6f3d91c584e5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:50.424162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d96c23-5743-462e-a496-6f3d91c584e5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:50.429572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e257f-e616-4ed5-bed5-3005cb53a0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:50.430190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e257f-e616-4ed5-bed5-3005cb53a0ca admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:50.430450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e257f-e616-4ed5-bed5-3005cb53a0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:50.430726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e257f-e616-4ed5-bed5-3005cb53a0ca admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:50.431454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e257f-e616-4ed5-bed5-3005cb53a0ca admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:50.456831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-a41e257f-e616-4ed5-bed5-3005cb53a0ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:21:50.456831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:21:50.456831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:21:50.457751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e257f-e616-4ed5-bed5-3005cb53a0ca admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:50.482492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 240/481] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:21:50 2021] POST /identity/v3/endpoints => generated 334 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:21:52.629939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e054ca-36aa-4cb9-b265-e5c8daf59e2e None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:52.630579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e054ca-36aa-4cb9-b265-e5c8daf59e2e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:52.630579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e054ca-36aa-4cb9-b265-e5c8daf59e2e None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:52.632321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 242/482] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:52.638734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38c6e6-5e66-4f1c-97c6-8fd782228762 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:52.639192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38c6e6-5e66-4f1c-97c6-8fd782228762 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:52.639701 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38c6e6-5e66-4f1c-97c6-8fd782228762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:52.675018 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4a38c6e6-5e66-4f1c-97c6-8fd782228762 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:52.676157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4a38c6e6-5e66-4f1c-97c6-8fd782228762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:52.693682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 241/483] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:52 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:52.716377 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e054ca-36aa-4cb9-b265-e5c8daf59e2e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:52.730023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e054ca-36aa-4cb9-b265-e5c8daf59e2e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:52.734544 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc583ba-e3a7-4d7a-a96c-eac1e15a812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:52.735336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc583ba-e3a7-4d7a-a96c-eac1e15a812c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:52.735616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc583ba-e3a7-4d7a-a96c-eac1e15a812c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:52.735884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc583ba-e3a7-4d7a-a96c-eac1e15a812c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:52.750704 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc583ba-e3a7-4d7a-a96c-eac1e15a812c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:52.757952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-6bc583ba-e3a7-4d7a-a96c-eac1e15a812c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:21:52.759180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 243/484] 10.222.0.67 () {56 vars in 1141 bytes} [Thu Dec 16 14:21:52 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:52.765491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38c6e6-5e66-4f1c-97c6-8fd782228762 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:52.775267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38c6e6-5e66-4f1c-97c6-8fd782228762 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:52.779896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e9bb-9db0-40df-a371-4dca3aa15c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:52.780498 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e9bb-9db0-40df-a371-4dca3aa15c72 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:52.780782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e9bb-9db0-40df-a371-4dca3aa15c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:52.781061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639e9bb-9db0-40df-a371-4dca3aa15c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:52.781823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639e9bb-9db0-40df-a371-4dca3aa15c72 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:52.782192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639e9bb-9db0-40df-a371-4dca3aa15c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:52.808789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639e9bb-9db0-40df-a371-4dca3aa15c72 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:52.822640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 242/485] 10.222.0.67 () {56 vars in 1136 bytes} [Thu Dec 16 14:21:52 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:21:52.828644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc583ba-e3a7-4d7a-a96c-eac1e15a812c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:52.838893 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc583ba-e3a7-4d7a-a96c-eac1e15a812c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:52.843599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d11bb-926d-4c12-a551-518879ecc50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:52.844331 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d11bb-926d-4c12-a551-518879ecc50a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:52.845197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d11bb-926d-4c12-a551-518879ecc50a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:52.845549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d11bb-926d-4c12-a551-518879ecc50a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:52.868926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d11bb-926d-4c12-a551-518879ecc50a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:52.896482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d11bb-926d-4c12-a551-518879ecc50a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:52.915227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-cb0d11bb-926d-4c12-a551-518879ecc50a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:52.916355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 244/486] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:52.922457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e9bb-9db0-40df-a371-4dca3aa15c72 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:52.932421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639e9bb-9db0-40df-a371-4dca3aa15c72 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:52.936461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7068c4c-29bc-49d5-8cae-bdddb2514fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:52.937055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068c4c-29bc-49d5-8cae-bdddb2514fdb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:52.937339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068c4c-29bc-49d5-8cae-bdddb2514fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:52.937613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068c4c-29bc-49d5-8cae-bdddb2514fdb admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:52.938467 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7068c4c-29bc-49d5-8cae-bdddb2514fdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:52.938808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7068c4c-29bc-49d5-8cae-bdddb2514fdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:52.964813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7068c4c-29bc-49d5-8cae-bdddb2514fdb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:52.979565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 243/487] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:52.985383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d11bb-926d-4c12-a551-518879ecc50a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:53.007037 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d11bb-926d-4c12-a551-518879ecc50a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:53.011407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca420888-dbc6-4942-906a-7a69a98042d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:53.012193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca420888-dbc6-4942-906a-7a69a98042d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.012485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca420888-dbc6-4942-906a-7a69a98042d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.012801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca420888-dbc6-4942-906a-7a69a98042d7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.027973 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca420888-dbc6-4942-906a-7a69a98042d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:53.054402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca420888-dbc6-4942-906a-7a69a98042d7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:53.074171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-ca420888-dbc6-4942-906a-7a69a98042d7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:21:53.075410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 245/488] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Dec 16 14:21:52 2021] GET /identity/v3/users/nova => generated 82 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:53.082314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7068c4c-29bc-49d5-8cae-bdddb2514fdb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:53.092563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7068c4c-29bc-49d5-8cae-bdddb2514fdb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:53.097460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84fc43-45e9-407c-b759-98898b0356e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:53.098104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84fc43-45e9-407c-b759-98898b0356e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.098404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84fc43-45e9-407c-b759-98898b0356e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.098686 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84fc43-45e9-407c-b759-98898b0356e4 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.099501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84fc43-45e9-407c-b759-98898b0356e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:53.099804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84fc43-45e9-407c-b759-98898b0356e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:53.125705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84fc43-45e9-407c-b759-98898b0356e4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:53.157305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 244/489] 10.222.0.67 () {56 vars in 1154 bytes} [Thu Dec 16 14:21:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:53.163218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca420888-dbc6-4942-906a-7a69a98042d7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:53.173397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca420888-dbc6-4942-906a-7a69a98042d7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:53.178644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359b496-97db-4f89-938c-c9d2908d40bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:53.179219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359b496-97db-4f89-938c-c9d2908d40bf admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.179509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359b496-97db-4f89-938c-c9d2908d40bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.179782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359b496-97db-4f89-938c-c9d2908d40bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.188593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359b496-97db-4f89-938c-c9d2908d40bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:53.217891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359b496-97db-4f89-938c-c9d2908d40bf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:53.228223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 246/490] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:53 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:53.234090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84fc43-45e9-407c-b759-98898b0356e4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:53.244404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84fc43-45e9-407c-b759-98898b0356e4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:53.249531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa3ef6-bd78-49cb-a04c-335150a90be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:53.250315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa3ef6-bd78-49cb-a04c-335150a90be6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.250599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa3ef6-bd78-49cb-a04c-335150a90be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.250916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa3ef6-bd78-49cb-a04c-335150a90be6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.264109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa3ef6-bd78-49cb-a04c-335150a90be6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:53.290255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa3ef6-bd78-49cb-a04c-335150a90be6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:53.310348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-7dfa3ef6-bd78-49cb-a04c-335150a90be6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:53.312993 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 245/491] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:21:53.318136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359b496-97db-4f89-938c-c9d2908d40bf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:53.327655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359b496-97db-4f89-938c-c9d2908d40bf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:53.335271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0bbc9-0270-47ae-9788-95e2a9e53434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:53.336331 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0bbc9-0270-47ae-9788-95e2a9e53434 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.336770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0bbc9-0270-47ae-9788-95e2a9e53434 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.337151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0bbc9-0270-47ae-9788-95e2a9e53434 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.337794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0bbc9-0270-47ae-9788-95e2a9e53434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:53.338129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0bbc9-0270-47ae-9788-95e2a9e53434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:53.364959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0bbc9-0270-47ae-9788-95e2a9e53434 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:53.378843 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 247/492] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:53.384721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa3ef6-bd78-49cb-a04c-335150a90be6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:53.394962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa3ef6-bd78-49cb-a04c-335150a90be6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:53.399874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f2a81-b410-44d5-867f-cfb3c5d73998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:53.400598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f2a81-b410-44d5-867f-cfb3c5d73998 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.400875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f2a81-b410-44d5-867f-cfb3c5d73998 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.401143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f2a81-b410-44d5-867f-cfb3c5d73998 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.412660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f2a81-b410-44d5-867f-cfb3c5d73998 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:53.439083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f2a81-b410-44d5-867f-cfb3c5d73998 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:53.454175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-f68f2a81-b410-44d5-867f-cfb3c5d73998 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:21:53.455443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 246/493] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:53.461961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0bbc9-0270-47ae-9788-95e2a9e53434 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:53.472095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0bbc9-0270-47ae-9788-95e2a9e53434 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:53.477142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44611d28-ed15-424b-af58-a64ef7e6db00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:53.477764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44611d28-ed15-424b-af58-a64ef7e6db00 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.478075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44611d28-ed15-424b-af58-a64ef7e6db00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.478354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44611d28-ed15-424b-af58-a64ef7e6db00 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.479109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44611d28-ed15-424b-af58-a64ef7e6db00 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:53.479410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44611d28-ed15-424b-af58-a64ef7e6db00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:53.506026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44611d28-ed15-424b-af58-a64ef7e6db00 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:53.520527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 248/494] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:21:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:53.526879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f2a81-b410-44d5-867f-cfb3c5d73998 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:53.537322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f2a81-b410-44d5-867f-cfb3c5d73998 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:53.544080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b29ec6-8967-4735-8ab3-4c56dac32cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:53.544686 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b29ec6-8967-4735-8ab3-4c56dac32cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:53.544968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b29ec6-8967-4735-8ab3-4c56dac32cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:53.545241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b29ec6-8967-4735-8ab3-4c56dac32cc5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:53.546050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b29ec6-8967-4735-8ab3-4c56dac32cc5 admin admin] RBAC: Adding query filter params (role.id=967b4cdf1e1f4431bd33c4e43e06506f, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f2bcc9f013f14ed89f5e94591f170b7b) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:53.546357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b29ec6-8967-4735-8ab3-4c56dac32cc5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:53.572428 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b29ec6-8967-4735-8ab3-4c56dac32cc5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:53.579250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 247/495] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:21:53 2021] GET /identity/v3/role_assignments?user.id=f2bcc9f013f14ed89f5e94591f170b7b&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=967b4cdf1e1f4431bd33c4e43e06506f => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:55.562504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3412bc-5646-445c-9c3c-7bce7060acfc None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:55.563032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3412bc-5646-445c-9c3c-7bce7060acfc None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:55.563032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3412bc-5646-445c-9c3c-7bce7060acfc None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:55.565056 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 249/496] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:55.570980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3edf6-0d8f-4d47-a673-b864aa9bb3a7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:55.571447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3edf6-0d8f-4d47-a673-b864aa9bb3a7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:55.571543 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3edf6-0d8f-4d47-a673-b864aa9bb3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:55.596545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4bc3edf6-0d8f-4d47-a673-b864aa9bb3a7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:55.597726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4bc3edf6-0d8f-4d47-a673-b864aa9bb3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:55.606032 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 248/497] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:55 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:55.628863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3412bc-5646-445c-9c3c-7bce7060acfc None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:55.642330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3412bc-5646-445c-9c3c-7bce7060acfc None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:55.647048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedb51a-e9e5-4574-b248-7c0bc2fcfbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:55.647807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedb51a-e9e5-4574-b248-7c0bc2fcfbad admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:55.648089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedb51a-e9e5-4574-b248-7c0bc2fcfbad admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:55.648368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedb51a-e9e5-4574-b248-7c0bc2fcfbad admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:55.660518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedb51a-e9e5-4574-b248-7c0bc2fcfbad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:55.667406 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-4bedb51a-e9e5-4574-b248-7c0bc2fcfbad admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:21:55.668514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 250/498] 10.222.0.67 () {56 vars in 1141 bytes} [Thu Dec 16 14:21:55 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:55.675315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3edf6-0d8f-4d47-a673-b864aa9bb3a7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:55.684564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3edf6-0d8f-4d47-a673-b864aa9bb3a7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:55.689443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c800e1-e48a-4967-8d10-10388b4a9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:55.690077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c800e1-e48a-4967-8d10-10388b4a9071 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:55.690364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c800e1-e48a-4967-8d10-10388b4a9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:55.690649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c800e1-e48a-4967-8d10-10388b4a9071 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:55.691385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c800e1-e48a-4967-8d10-10388b4a9071 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:55.691683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c800e1-e48a-4967-8d10-10388b4a9071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:55.717008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c800e1-e48a-4967-8d10-10388b4a9071 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:55.726607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 249/499] 10.222.0.67 () {56 vars in 1136 bytes} [Thu Dec 16 14:21:55 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:55.732139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedb51a-e9e5-4574-b248-7c0bc2fcfbad admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:55.744502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedb51a-e9e5-4574-b248-7c0bc2fcfbad admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:55.749583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497b889-884a-43c6-ae5d-317908e4d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:55.750325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497b889-884a-43c6-ae5d-317908e4d78a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:55.750606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497b889-884a-43c6-ae5d-317908e4d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:55.750902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497b889-884a-43c6-ae5d-317908e4d78a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:55.762948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497b889-884a-43c6-ae5d-317908e4d78a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:55.788689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497b889-884a-43c6-ae5d-317908e4d78a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:55.807724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-4497b889-884a-43c6-ae5d-317908e4d78a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:55.808859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 251/500] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:55.815079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c800e1-e48a-4967-8d10-10388b4a9071 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:55.825209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c800e1-e48a-4967-8d10-10388b4a9071 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:55.830166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d66ce6-2d80-4f4d-9aa7-6427c7dd172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:55.830776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d66ce6-2d80-4f4d-9aa7-6427c7dd172d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:55.831063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d66ce6-2d80-4f4d-9aa7-6427c7dd172d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:55.831342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d66ce6-2d80-4f4d-9aa7-6427c7dd172d admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:55.832050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d66ce6-2d80-4f4d-9aa7-6427c7dd172d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:55.832349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d66ce6-2d80-4f4d-9aa7-6427c7dd172d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:55.857892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d66ce6-2d80-4f4d-9aa7-6427c7dd172d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:55.872029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 250/501] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:55.877888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497b889-884a-43c6-ae5d-317908e4d78a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:55.887351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497b889-884a-43c6-ae5d-317908e4d78a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:55.891631 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607bac-f344-4274-a64c-f80b12a8f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:55.892402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607bac-f344-4274-a64c-f80b12a8f9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:55.892691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607bac-f344-4274-a64c-f80b12a8f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:55.892986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607bac-f344-4274-a64c-f80b12a8f9a6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:55.906290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607bac-f344-4274-a64c-f80b12a8f9a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:55.932672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607bac-f344-4274-a64c-f80b12a8f9a6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:55.951684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-07607bac-f344-4274-a64c-f80b12a8f9a6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:21:55.952830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 252/502] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Dec 16 14:21:55 2021] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:55.958891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d66ce6-2d80-4f4d-9aa7-6427c7dd172d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:55.968960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d66ce6-2d80-4f4d-9aa7-6427c7dd172d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:55.974123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42105553-3bde-4c8e-a439-e2d35eeb6dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:55.974730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42105553-3bde-4c8e-a439-e2d35eeb6dda admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:55.975012 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42105553-3bde-4c8e-a439-e2d35eeb6dda admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:55.975289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42105553-3bde-4c8e-a439-e2d35eeb6dda admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:55.976084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42105553-3bde-4c8e-a439-e2d35eeb6dda admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:55.976383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42105553-3bde-4c8e-a439-e2d35eeb6dda admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:56.001887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42105553-3bde-4c8e-a439-e2d35eeb6dda admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:56.031803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 251/503] 10.222.0.67 () {56 vars in 1154 bytes} [Thu Dec 16 14:21:55 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:56.037909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607bac-f344-4274-a64c-f80b12a8f9a6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:56.048155 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607bac-f344-4274-a64c-f80b12a8f9a6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:56.053200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ec46-1141-4990-a676-64587ec6b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:56.053932 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ec46-1141-4990-a676-64587ec6b827 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:56.054245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ec46-1141-4990-a676-64587ec6b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:56.054522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ec46-1141-4990-a676-64587ec6b827 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:56.068083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4ec46-1141-4990-a676-64587ec6b827 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:56.094040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4ec46-1141-4990-a676-64587ec6b827 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:56.112304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-dea4ec46-1141-4990-a676-64587ec6b827 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:56.113429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 253/504] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:56.119423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42105553-3bde-4c8e-a439-e2d35eeb6dda admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:56.144423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42105553-3bde-4c8e-a439-e2d35eeb6dda admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:56.149183 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6cb77-f661-4767-8232-c73bee37dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:56.149803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6cb77-f661-4767-8232-c73bee37dedd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:56.150139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6cb77-f661-4767-8232-c73bee37dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:56.150416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6cb77-f661-4767-8232-c73bee37dedd admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:56.151105 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6cb77-f661-4767-8232-c73bee37dedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:56.151398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6cb77-f661-4767-8232-c73bee37dedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:56.176938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6cb77-f661-4767-8232-c73bee37dedd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:56.191579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 252/505] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:56.198669 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ec46-1141-4990-a676-64587ec6b827 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:56.209456 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ec46-1141-4990-a676-64587ec6b827 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:56.216050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f9f5-1ed5-4aa5-963b-f9eb602e309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:56.216801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f9f5-1ed5-4aa5-963b-f9eb602e309c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:56.217083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f9f5-1ed5-4aa5-963b-f9eb602e309c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:56.217357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f9f5-1ed5-4aa5-963b-f9eb602e309c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:56.227930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9f9f5-1ed5-4aa5-963b-f9eb602e309c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:56.253591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9f9f5-1ed5-4aa5-963b-f9eb602e309c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:56.268622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-bac9f9f5-1ed5-4aa5-963b-f9eb602e309c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:21:56.269773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 254/506] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:56.275839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6cb77-f661-4767-8232-c73bee37dedd admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:56.287142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6cb77-f661-4767-8232-c73bee37dedd admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:56.292523 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845cafe-6205-43a8-82b2-a92d52eab0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:56.293124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845cafe-6205-43a8-82b2-a92d52eab0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:56.293405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845cafe-6205-43a8-82b2-a92d52eab0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:56.293673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845cafe-6205-43a8-82b2-a92d52eab0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:56.294447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845cafe-6205-43a8-82b2-a92d52eab0d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:56.294767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845cafe-6205-43a8-82b2-a92d52eab0d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:56.321188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845cafe-6205-43a8-82b2-a92d52eab0d0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:56.336140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 253/507] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:21:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:56.342411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f9f5-1ed5-4aa5-963b-f9eb602e309c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:56.353045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f9f5-1ed5-4aa5-963b-f9eb602e309c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:56.358505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb057a-4d6e-4194-996f-f03e88fb89f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:56.359371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb057a-4d6e-4194-996f-f03e88fb89f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:56.359653 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb057a-4d6e-4194-996f-f03e88fb89f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:56.359930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb057a-4d6e-4194-996f-f03e88fb89f0 admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f2bcc9f013f14ed89f5e94591f170b7b/roles/967b4cdf1e1f4431bd33c4e43e06506f` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:56.362625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb057a-4d6e-4194-996f-f03e88fb89f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=f2bcc9f013f14ed89f5e94591f170b7b, role_id=967b4cdf1e1f4431bd33c4e43e06506f)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:56.389038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb057a-4d6e-4194-996f-f03e88fb89f0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:56.405898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 255/508] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:21:56 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f2bcc9f013f14ed89f5e94591f170b7b/roles/967b4cdf1e1f4431bd33c4e43e06506f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:21:58.391138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d691-821e-4596-8960-ae61d85d8abc None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.391716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d691-821e-4596-8960-ae61d85d8abc None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.391716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d691-821e-4596-8960-ae61d85d8abc None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.393725 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 254/509] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:21:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:21:58.399211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273622f6-e883-482c-a6ab-c46962789ae4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.399674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273622f6-e883-482c-a6ab-c46962789ae4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.399762 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273622f6-e883-482c-a6ab-c46962789ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.423441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-273622f6-e883-482c-a6ab-c46962789ae4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:21:58.424606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-273622f6-e883-482c-a6ab-c46962789ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:21:58.492200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 256/510] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:21:58 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:21:58.524353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656d691-821e-4596-8960-ae61d85d8abc None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:58.546104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656d691-821e-4596-8960-ae61d85d8abc None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:58.552283 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2ea4-c4b3-4c2a-84fc-f9928c796c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:58.553047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2ea4-c4b3-4c2a-84fc-f9928c796c00 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.553330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2ea4-c4b3-4c2a-84fc-f9928c796c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.553608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2ea4-c4b3-4c2a-84fc-f9928c796c00 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.567084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b2ea4-c4b3-4c2a-84fc-f9928c796c00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:21:58.574083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-bf1b2ea4-c4b3-4c2a-84fc-f9928c796c00 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:21:58.575239 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 255/511] 10.222.0.67 () {56 vars in 1141 bytes} [Thu Dec 16 14:21:58 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:58.585061 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273622f6-e883-482c-a6ab-c46962789ae4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:58.599323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273622f6-e883-482c-a6ab-c46962789ae4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:58.607161 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ba469-d793-418a-aeb4-2afd22caa647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:58.608160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ba469-d793-418a-aeb4-2afd22caa647 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.608607 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ba469-d793-418a-aeb4-2afd22caa647 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.609053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ba469-d793-418a-aeb4-2afd22caa647 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.610276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ba469-d793-418a-aeb4-2afd22caa647 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:58.611003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ba469-d793-418a-aeb4-2afd22caa647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:58.635890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ba469-d793-418a-aeb4-2afd22caa647 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:58.645565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 257/512] 10.222.0.67 () {56 vars in 1136 bytes} [Thu Dec 16 14:21:58 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:58.652255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2ea4-c4b3-4c2a-84fc-f9928c796c00 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:58.669309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2ea4-c4b3-4c2a-84fc-f9928c796c00 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:58.676479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694b12c-f5a8-4ba4-b211-d7a8df80af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:58.677192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694b12c-f5a8-4ba4-b211-d7a8df80af2a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.677498 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694b12c-f5a8-4ba4-b211-d7a8df80af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.677777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694b12c-f5a8-4ba4-b211-d7a8df80af2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.690505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694b12c-f5a8-4ba4-b211-d7a8df80af2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:58.717146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694b12c-f5a8-4ba4-b211-d7a8df80af2a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:58.736785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-3694b12c-f5a8-4ba4-b211-d7a8df80af2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:58.737957 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 256/513] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:58.744075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ba469-d793-418a-aeb4-2afd22caa647 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:58.754357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ba469-d793-418a-aeb4-2afd22caa647 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:58.759472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edf8d7-36c8-4fbd-9939-96c16314f2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:58.760073 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf8d7-36c8-4fbd-9939-96c16314f2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.760349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf8d7-36c8-4fbd-9939-96c16314f2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.760624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf8d7-36c8-4fbd-9939-96c16314f2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.761337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edf8d7-36c8-4fbd-9939-96c16314f2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:58.761627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edf8d7-36c8-4fbd-9939-96c16314f2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:58.787107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edf8d7-36c8-4fbd-9939-96c16314f2e2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:58.801296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 258/514] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:58.807217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694b12c-f5a8-4ba4-b211-d7a8df80af2a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:58.819366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694b12c-f5a8-4ba4-b211-d7a8df80af2a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:58.825407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08fa75-7d2d-47ef-94ba-744d27ab8ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:58.826222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08fa75-7d2d-47ef-94ba-744d27ab8ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.826508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08fa75-7d2d-47ef-94ba-744d27ab8ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.826782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08fa75-7d2d-47ef-94ba-744d27ab8ee1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.841880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08fa75-7d2d-47ef-94ba-744d27ab8ee1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:58.869207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08fa75-7d2d-47ef-94ba-744d27ab8ee1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:58.890272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-bd08fa75-7d2d-47ef-94ba-744d27ab8ee1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 16 14:21:58.891494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 257/515] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Dec 16 14:21:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:58.898437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edf8d7-36c8-4fbd-9939-96c16314f2e2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:58.909218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edf8d7-36c8-4fbd-9939-96c16314f2e2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:58.914289 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a68cb5-58e4-4e0d-88df-a8c07a456863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:58.914911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a68cb5-58e4-4e0d-88df-a8c07a456863 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:58.915195 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a68cb5-58e4-4e0d-88df-a8c07a456863 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:58.915473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a68cb5-58e4-4e0d-88df-a8c07a456863 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:58.916296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a68cb5-58e4-4e0d-88df-a8c07a456863 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:58.916596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a68cb5-58e4-4e0d-88df-a8c07a456863 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:58.943149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a68cb5-58e4-4e0d-88df-a8c07a456863 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:58.975574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 259/516] 10.222.0.67 () {56 vars in 1154 bytes} [Thu Dec 16 14:21:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:58.981492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08fa75-7d2d-47ef-94ba-744d27ab8ee1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:58.994226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08fa75-7d2d-47ef-94ba-744d27ab8ee1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:59.002122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeab1e-9c1f-420a-9916-d63cf6604936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:59.002700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeab1e-9c1f-420a-9916-d63cf6604936 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:59.002975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeab1e-9c1f-420a-9916-d63cf6604936 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:59.003251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeab1e-9c1f-420a-9916-d63cf6604936 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:59.012107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeab1e-9c1f-420a-9916-d63cf6604936 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:59.037701 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeab1e-9c1f-420a-9916-d63cf6604936 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:59.047259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 258/517] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:21:58 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:21:59.053104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a68cb5-58e4-4e0d-88df-a8c07a456863 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:59.063118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a68cb5-58e4-4e0d-88df-a8c07a456863 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:59.068170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb1031-5968-4240-b256-67ef7b59e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:59.068917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb1031-5968-4240-b256-67ef7b59e8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:59.069206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb1031-5968-4240-b256-67ef7b59e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:59.069482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb1031-5968-4240-b256-67ef7b59e8a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:59.081753 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb1031-5968-4240-b256-67ef7b59e8a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:59.107347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb1031-5968-4240-b256-67ef7b59e8a6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:59.125610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-8edb1031-5968-4240-b256-67ef7b59e8a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:21:59.126862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 260/518] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:21:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:59.132590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeab1e-9c1f-420a-9916-d63cf6604936 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:59.141441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeab1e-9c1f-420a-9916-d63cf6604936 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:59.145784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05688cc-9e95-49ea-987b-5007cecb2be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:59.146412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05688cc-9e95-49ea-987b-5007cecb2be4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:59.146666 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05688cc-9e95-49ea-987b-5007cecb2be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:59.146951 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05688cc-9e95-49ea-987b-5007cecb2be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:59.147624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05688cc-9e95-49ea-987b-5007cecb2be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:59.147914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05688cc-9e95-49ea-987b-5007cecb2be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:59.173539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05688cc-9e95-49ea-987b-5007cecb2be4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:59.186997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 259/519] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:21:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:59.192969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb1031-5968-4240-b256-67ef7b59e8a6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:59.202872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb1031-5968-4240-b256-67ef7b59e8a6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:59.207996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177f65c-5ba0-449b-bb22-cb01d9b67c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:59.208734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177f65c-5ba0-449b-bb22-cb01d9b67c0a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:59.209006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177f65c-5ba0-449b-bb22-cb01d9b67c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:59.209275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177f65c-5ba0-449b-bb22-cb01d9b67c0a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:59.220105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177f65c-5ba0-449b-bb22-cb01d9b67c0a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:59.245404 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177f65c-5ba0-449b-bb22-cb01d9b67c0a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:59.259606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-7177f65c-5ba0-449b-bb22-cb01d9b67c0a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:21:59.260703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 261/520] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:21:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:21:59.266979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05688cc-9e95-49ea-987b-5007cecb2be4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:59.276985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05688cc-9e95-49ea-987b-5007cecb2be4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:59.282222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b04442-7b70-4667-85a7-9582adb9d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:59.283225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b04442-7b70-4667-85a7-9582adb9d3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:59.283511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b04442-7b70-4667-85a7-9582adb9d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:59.283785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b04442-7b70-4667-85a7-9582adb9d3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:59.284529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b04442-7b70-4667-85a7-9582adb9d3d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:59.284825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b04442-7b70-4667-85a7-9582adb9d3d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:59.311245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b04442-7b70-4667-85a7-9582adb9d3d4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:59.324976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 260/521] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:21:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:21:59.331522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177f65c-5ba0-449b-bb22-cb01d9b67c0a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:21:59.341306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177f65c-5ba0-449b-bb22-cb01d9b67c0a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:21:59.346184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6234acf-f55a-4855-9077-0a42bf8b355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:21:59.346773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6234acf-f55a-4855-9077-0a42bf8b355c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:21:59.347059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6234acf-f55a-4855-9077-0a42bf8b355c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:21:59.347343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6234acf-f55a-4855-9077-0a42bf8b355c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:21:59.348131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6234acf-f55a-4855-9077-0a42bf8b355c admin admin] RBAC: Adding query filter params (role.id=967b4cdf1e1f4431bd33c4e43e06506f, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f2bcc9f013f14ed89f5e94591f170b7b) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:21:59.348444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6234acf-f55a-4855-9077-0a42bf8b355c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:21:59.374090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6234acf-f55a-4855-9077-0a42bf8b355c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:21:59.380609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 262/522] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:21:59 2021] GET /identity/v3/role_assignments?user.id=f2bcc9f013f14ed89f5e94591f170b7b&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=967b4cdf1e1f4431bd33c4e43e06506f => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:01.475045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8dfd9-e55e-4884-ad6c-fa89b1a9c2ce None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:01.475567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8dfd9-e55e-4884-ad6c-fa89b1a9c2ce None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:01.475567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8dfd9-e55e-4884-ad6c-fa89b1a9c2ce None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:01.477177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 261/523] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:01.482585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04daa6e-eb10-4dd1-958a-c7aec4231f76 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:01.483003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04daa6e-eb10-4dd1-958a-c7aec4231f76 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:01.483118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04daa6e-eb10-4dd1-958a-c7aec4231f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:01.506975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-f04daa6e-eb10-4dd1-958a-c7aec4231f76 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:01.508155 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f04daa6e-eb10-4dd1-958a-c7aec4231f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:01.516652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 263/524] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:01 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:01.540477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8dfd9-e55e-4884-ad6c-fa89b1a9c2ce None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:01.554837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8dfd9-e55e-4884-ad6c-fa89b1a9c2ce None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:01.559751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a906c8d-c085-48d2-a220-5fbd459faca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:01.560490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a906c8d-c085-48d2-a220-5fbd459faca3 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:01.560790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a906c8d-c085-48d2-a220-5fbd459faca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:01.561067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a906c8d-c085-48d2-a220-5fbd459faca3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:01.573370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a906c8d-c085-48d2-a220-5fbd459faca3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:01.598943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a906c8d-c085-48d2-a220-5fbd459faca3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:01.616806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-2a906c8d-c085-48d2-a220-5fbd459faca3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:01.617920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 262/525] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:01.624257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04daa6e-eb10-4dd1-958a-c7aec4231f76 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:01.633483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04daa6e-eb10-4dd1-958a-c7aec4231f76 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:01.638829 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b4d4e-7dcc-4e93-a5f7-de64771a2a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:01.639427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b4d4e-7dcc-4e93-a5f7-de64771a2a2b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:01.639707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b4d4e-7dcc-4e93-a5f7-de64771a2a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:01.639978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b4d4e-7dcc-4e93-a5f7-de64771a2a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:01.640670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b4d4e-7dcc-4e93-a5f7-de64771a2a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:01.640971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b4d4e-7dcc-4e93-a5f7-de64771a2a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:01.666390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b4d4e-7dcc-4e93-a5f7-de64771a2a2b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:01.680122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 264/526] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:01.686082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a906c8d-c085-48d2-a220-5fbd459faca3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:01.695692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a906c8d-c085-48d2-a220-5fbd459faca3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:01.700774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ab146-d36c-4b3b-a8e5-ec65e10c7d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:01.701365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ab146-d36c-4b3b-a8e5-ec65e10c7d3e admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:01.701642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ab146-d36c-4b3b-a8e5-ec65e10c7d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:01.701911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ab146-d36c-4b3b-a8e5-ec65e10c7d3e admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:01.702591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ab146-d36c-4b3b-a8e5-ec65e10c7d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:01.728871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ab146-d36c-4b3b-a8e5-ec65e10c7d3e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:01.752066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 263/527] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:22:01 2021] POST /identity/v3/users => generated 248 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:22:03.753686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e809-5da9-4ee3-9b7c-7bdc950900a7 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:03.754651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e809-5da9-4ee3-9b7c-7bdc950900a7 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:03.754651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e809-5da9-4ee3-9b7c-7bdc950900a7 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:03.756520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 265/528] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:03.762224 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd961a3-6f15-4c66-b489-bb47c24a369d None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:03.762691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd961a3-6f15-4c66-b489-bb47c24a369d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:03.762796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd961a3-6f15-4c66-b489-bb47c24a369d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:03.785384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-5dd961a3-6f15-4c66-b489-bb47c24a369d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:03.786560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5dd961a3-6f15-4c66-b489-bb47c24a369d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:03.793774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 264/529] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:03 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:03.818245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483e809-5da9-4ee3-9b7c-7bdc950900a7 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:03.833539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483e809-5da9-4ee3-9b7c-7bdc950900a7 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:03.838434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db86ee-ef72-4e77-862a-e05fa7c98f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:03.839173 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db86ee-ef72-4e77-862a-e05fa7c98f32 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:03.839455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db86ee-ef72-4e77-862a-e05fa7c98f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:03.839730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db86ee-ef72-4e77-862a-e05fa7c98f32 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:03.852625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db86ee-ef72-4e77-862a-e05fa7c98f32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:03.859255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-b6db86ee-ef72-4e77-862a-e05fa7c98f32 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:22:03.860412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 266/530] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:22:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:03.867098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd961a3-6f15-4c66-b489-bb47c24a369d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:03.875933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd961a3-6f15-4c66-b489-bb47c24a369d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:03.880921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29d23-8683-4e2f-9c79-6452a4aac08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:03.881509 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29d23-8683-4e2f-9c79-6452a4aac08f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:03.881792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29d23-8683-4e2f-9c79-6452a4aac08f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:03.882099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29d23-8683-4e2f-9c79-6452a4aac08f admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:03.882801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29d23-8683-4e2f-9c79-6452a4aac08f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:03.883098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29d23-8683-4e2f-9c79-6452a4aac08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:03.909391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29d23-8683-4e2f-9c79-6452a4aac08f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:03.918484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 265/531] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:22:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:03.925175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db86ee-ef72-4e77-862a-e05fa7c98f32 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:03.935486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db86ee-ef72-4e77-862a-e05fa7c98f32 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:03.940428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847384-8b22-421d-ab7a-1f036ea49c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:03.941144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847384-8b22-421d-ab7a-1f036ea49c90 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:03.941428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847384-8b22-421d-ab7a-1f036ea49c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:03.941703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847384-8b22-421d-ab7a-1f036ea49c90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:03.953353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df847384-8b22-421d-ab7a-1f036ea49c90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:03.980069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df847384-8b22-421d-ab7a-1f036ea49c90 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:03.998568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-df847384-8b22-421d-ab7a-1f036ea49c90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:03.999655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 267/532] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:04.006445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29d23-8683-4e2f-9c79-6452a4aac08f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:04.016060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29d23-8683-4e2f-9c79-6452a4aac08f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:04.020850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dec51-ee5b-4542-a002-0d4e2161c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:04.021470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dec51-ee5b-4542-a002-0d4e2161c85f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:04.021755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dec51-ee5b-4542-a002-0d4e2161c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:04.022033 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dec51-ee5b-4542-a002-0d4e2161c85f admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:04.022778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dec51-ee5b-4542-a002-0d4e2161c85f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:04.023075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dec51-ee5b-4542-a002-0d4e2161c85f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:04.049269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dec51-ee5b-4542-a002-0d4e2161c85f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:04.062741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 266/533] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:04.069242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847384-8b22-421d-ab7a-1f036ea49c90 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:04.079335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847384-8b22-421d-ab7a-1f036ea49c90 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:04.084703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b98da-5d01-4892-9c95-92db911b5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:04.085495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b98da-5d01-4892-9c95-92db911b5ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:04.085785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b98da-5d01-4892-9c95-92db911b5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:04.086096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b98da-5d01-4892-9c95-92db911b5ae6 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:04.099731 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b98da-5d01-4892-9c95-92db911b5ae6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:04.125634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b98da-5d01-4892-9c95-92db911b5ae6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:04.145041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-2f4b98da-5d01-4892-9c95-92db911b5ae6 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 16 14:22:04.146208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 268/534] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:04 2021] GET /identity/v3/users/glance => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:04.152886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dec51-ee5b-4542-a002-0d4e2161c85f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:04.163362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dec51-ee5b-4542-a002-0d4e2161c85f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:04.167674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589eee0-dae4-4b59-9b13-77629cb1e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:04.168282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589eee0-dae4-4b59-9b13-77629cb1e434 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:04.168569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589eee0-dae4-4b59-9b13-77629cb1e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:04.168851 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589eee0-dae4-4b59-9b13-77629cb1e434 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:04.169640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589eee0-dae4-4b59-9b13-77629cb1e434 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:04.169948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589eee0-dae4-4b59-9b13-77629cb1e434 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:04.195994 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589eee0-dae4-4b59-9b13-77629cb1e434 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:04.226731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 267/535] 10.222.0.67 () {56 vars in 1158 bytes} [Thu Dec 16 14:22:04 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:04.232737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b98da-5d01-4892-9c95-92db911b5ae6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:04.242562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b98da-5d01-4892-9c95-92db911b5ae6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:04.247111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aec478-35d8-4a22-a86c-32fffcf5c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:04.247676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aec478-35d8-4a22-a86c-32fffcf5c1bd admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:04.247959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aec478-35d8-4a22-a86c-32fffcf5c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:04.248241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aec478-35d8-4a22-a86c-32fffcf5c1bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:04.260108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aec478-35d8-4a22-a86c-32fffcf5c1bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:04.286076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aec478-35d8-4a22-a86c-32fffcf5c1bd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:04.295513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 269/536] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:04 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:04.302015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589eee0-dae4-4b59-9b13-77629cb1e434 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:04.311741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589eee0-dae4-4b59-9b13-77629cb1e434 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:04.316263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069ec49-e9da-4cd2-a582-f88bade3a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:04.316997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069ec49-e9da-4cd2-a582-f88bade3a533 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:04.317285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069ec49-e9da-4cd2-a582-f88bade3a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:04.317566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069ec49-e9da-4cd2-a582-f88bade3a533 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:04.330705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069ec49-e9da-4cd2-a582-f88bade3a533 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:04.356135 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069ec49-e9da-4cd2-a582-f88bade3a533 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:04.374564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-8069ec49-e9da-4cd2-a582-f88bade3a533 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:04.375684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 268/537] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:22:04.381613 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aec478-35d8-4a22-a86c-32fffcf5c1bd admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:04.391463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aec478-35d8-4a22-a86c-32fffcf5c1bd admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:04.395850 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3e1b8-7f84-4e09-b500-37100b2f3a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:04.396427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3e1b8-7f84-4e09-b500-37100b2f3a30 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:04.396703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3e1b8-7f84-4e09-b500-37100b2f3a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:04.396982 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3e1b8-7f84-4e09-b500-37100b2f3a30 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:04.397657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3e1b8-7f84-4e09-b500-37100b2f3a30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:04.397951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3e1b8-7f84-4e09-b500-37100b2f3a30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:04.423459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3e1b8-7f84-4e09-b500-37100b2f3a30 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:04.437187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 270/538] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:04.443357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069ec49-e9da-4cd2-a582-f88bade3a533 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:04.453509 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069ec49-e9da-4cd2-a582-f88bade3a533 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:04.458905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a35eff-d915-4403-bf46-74483013f0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:04.459634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a35eff-d915-4403-bf46-74483013f0bf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:04.459915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a35eff-d915-4403-bf46-74483013f0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:04.460194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a35eff-d915-4403-bf46-74483013f0bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:04.469621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a35eff-d915-4403-bf46-74483013f0bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:04.501004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a35eff-d915-4403-bf46-74483013f0bf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:04.516676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-26a35eff-d915-4403-bf46-74483013f0bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:04.518154 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 269/539] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:04.524253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3e1b8-7f84-4e09-b500-37100b2f3a30 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:04.534624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3e1b8-7f84-4e09-b500-37100b2f3a30 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:04.539672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c694aeb-0962-441c-9cfe-b76a85ff7eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:04.540251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c694aeb-0962-441c-9cfe-b76a85ff7eeb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:04.540539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c694aeb-0962-441c-9cfe-b76a85ff7eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:04.540815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c694aeb-0962-441c-9cfe-b76a85ff7eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:04.541564 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c694aeb-0962-441c-9cfe-b76a85ff7eeb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:04.541869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c694aeb-0962-441c-9cfe-b76a85ff7eeb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:04.567890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c694aeb-0962-441c-9cfe-b76a85ff7eeb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:04.581672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 271/540] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:04.587891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a35eff-d915-4403-bf46-74483013f0bf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:04.597938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a35eff-d915-4403-bf46-74483013f0bf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:04.603208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44bff0-4d35-447e-abbd-000e49a18d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:04.603783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44bff0-4d35-447e-abbd-000e49a18d44 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:04.604061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44bff0-4d35-447e-abbd-000e49a18d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:04.604331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44bff0-4d35-447e-abbd-000e49a18d44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:04.605107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44bff0-4d35-447e-abbd-000e49a18d44 admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=0b797c99041b4e9c9cde7d0064013fda) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:04.605407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44bff0-4d35-447e-abbd-000e49a18d44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:04.630794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44bff0-4d35-447e-abbd-000e49a18d44 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:04.636646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 270/541] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:04 2021] GET /identity/v3/role_assignments?user.id=0b797c99041b4e9c9cde7d0064013fda&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:22:06.667191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3417c85-f325-497b-a3b1-db884e8f6de1 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:06.668022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3417c85-f325-497b-a3b1-db884e8f6de1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:06.668022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3417c85-f325-497b-a3b1-db884e8f6de1 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:06.669471 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 272/542] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:06.679516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c0691-fd79-4d0c-b0ec-28de80d8a2d1 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:06.680047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c0691-fd79-4d0c-b0ec-28de80d8a2d1 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:06.680167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c0691-fd79-4d0c-b0ec-28de80d8a2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:06.715731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-613c0691-fd79-4d0c-b0ec-28de80d8a2d1 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:06.717022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-613c0691-fd79-4d0c-b0ec-28de80d8a2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:06.726681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 271/543] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:06 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:06.755818 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3417c85-f325-497b-a3b1-db884e8f6de1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:06.772321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3417c85-f325-497b-a3b1-db884e8f6de1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:06.777363 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363dc9f-7608-4330-a91e-88811ebc5179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:06.779129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363dc9f-7608-4330-a91e-88811ebc5179 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:06.779129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363dc9f-7608-4330-a91e-88811ebc5179 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:06.779129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363dc9f-7608-4330-a91e-88811ebc5179 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:06.794808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363dc9f-7608-4330-a91e-88811ebc5179 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:06.802881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-0363dc9f-7608-4330-a91e-88811ebc5179 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:22:06.804960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 273/544] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:22:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:06.812319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c0691-fd79-4d0c-b0ec-28de80d8a2d1 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:06.823928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c0691-fd79-4d0c-b0ec-28de80d8a2d1 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:06.828518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86bfc3-87e3-4386-92f4-87e3758879f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:06.829120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86bfc3-87e3-4386-92f4-87e3758879f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:06.829406 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86bfc3-87e3-4386-92f4-87e3758879f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:06.829853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86bfc3-87e3-4386-92f4-87e3758879f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:06.830830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86bfc3-87e3-4386-92f4-87e3758879f2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:06.831133 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86bfc3-87e3-4386-92f4-87e3758879f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:06.856800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86bfc3-87e3-4386-92f4-87e3758879f2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:06.866695 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 272/545] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:22:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:06.872557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363dc9f-7608-4330-a91e-88811ebc5179 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:06.882802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363dc9f-7608-4330-a91e-88811ebc5179 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:06.887260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3209-ecec-44cd-beb8-a0567f3706b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:06.887975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3209-ecec-44cd-beb8-a0567f3706b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:06.888265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3209-ecec-44cd-beb8-a0567f3706b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:06.888543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3209-ecec-44cd-beb8-a0567f3706b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:06.900408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f3209-ecec-44cd-beb8-a0567f3706b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:06.926529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f3209-ecec-44cd-beb8-a0567f3706b4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:06.945439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-5d3f3209-ecec-44cd-beb8-a0567f3706b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:06.946596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 274/546] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:06.952484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86bfc3-87e3-4386-92f4-87e3758879f2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:06.962812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86bfc3-87e3-4386-92f4-87e3758879f2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:06.968122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace6229-14eb-42fd-b8d0-910cb503c5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:06.968748 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6229-14eb-42fd-b8d0-910cb503c5cf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:06.969027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6229-14eb-42fd-b8d0-910cb503c5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:06.969299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6229-14eb-42fd-b8d0-910cb503c5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:06.969974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace6229-14eb-42fd-b8d0-910cb503c5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:06.970431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace6229-14eb-42fd-b8d0-910cb503c5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:06.995892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace6229-14eb-42fd-b8d0-910cb503c5cf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:07.009724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 273/547] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:07.015703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3209-ecec-44cd-beb8-a0567f3706b4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:07.026514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3209-ecec-44cd-beb8-a0567f3706b4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:07.031719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e769df2-8912-46cd-bfcf-933b4c2ac1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:07.032473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769df2-8912-46cd-bfcf-933b4c2ac1bc admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:07.032814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769df2-8912-46cd-bfcf-933b4c2ac1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:07.033145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e769df2-8912-46cd-bfcf-933b4c2ac1bc admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:07.047592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e769df2-8912-46cd-bfcf-933b4c2ac1bc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:07.073853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e769df2-8912-46cd-bfcf-933b4c2ac1bc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:07.094172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-0e769df2-8912-46cd-bfcf-933b4c2ac1bc admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 16 14:22:07.095440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 275/548] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:07 2021] GET /identity/v3/users/glance => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:07.101323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace6229-14eb-42fd-b8d0-910cb503c5cf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:07.112160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace6229-14eb-42fd-b8d0-910cb503c5cf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:07.117232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e1d3d-41a8-4e9f-822c-c9f497064910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:07.117904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e1d3d-41a8-4e9f-822c-c9f497064910 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:07.118236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e1d3d-41a8-4e9f-822c-c9f497064910 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:07.118510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e1d3d-41a8-4e9f-822c-c9f497064910 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:07.119292 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e1d3d-41a8-4e9f-822c-c9f497064910 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:07.119587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e1d3d-41a8-4e9f-822c-c9f497064910 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:07.145401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e1d3d-41a8-4e9f-822c-c9f497064910 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:07.175066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 274/549] 10.222.0.67 () {56 vars in 1158 bytes} [Thu Dec 16 14:22:07 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:07.180768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e769df2-8912-46cd-bfcf-933b4c2ac1bc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:07.190554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e769df2-8912-46cd-bfcf-933b4c2ac1bc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:07.194964 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b109e9-c318-4936-8fc4-16a20262f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:07.195679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b109e9-c318-4936-8fc4-16a20262f294 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:07.195957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b109e9-c318-4936-8fc4-16a20262f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:07.196226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b109e9-c318-4936-8fc4-16a20262f294 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:07.209126 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b109e9-c318-4936-8fc4-16a20262f294 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:07.237803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b109e9-c318-4936-8fc4-16a20262f294 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:07.255466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-59b109e9-c318-4936-8fc4-16a20262f294 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:07.256619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 276/550] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:07.262629 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e1d3d-41a8-4e9f-822c-c9f497064910 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:07.272389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e1d3d-41a8-4e9f-822c-c9f497064910 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:07.276857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2c5fe-8654-4a45-ae60-d85f95c22bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:07.277442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2c5fe-8654-4a45-ae60-d85f95c22bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:07.277730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2c5fe-8654-4a45-ae60-d85f95c22bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:07.278026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2c5fe-8654-4a45-ae60-d85f95c22bc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:07.278724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2c5fe-8654-4a45-ae60-d85f95c22bc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:07.279016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2c5fe-8654-4a45-ae60-d85f95c22bc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:07.304769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2c5fe-8654-4a45-ae60-d85f95c22bc7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:07.317571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 275/551] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:07.323338 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b109e9-c318-4936-8fc4-16a20262f294 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:07.333253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b109e9-c318-4936-8fc4-16a20262f294 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:07.337786 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029901c-ea35-45f9-9ab5-43809d2b16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:07.338549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029901c-ea35-45f9-9ab5-43809d2b16e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:07.338824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029901c-ea35-45f9-9ab5-43809d2b16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:07.339128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029901c-ea35-45f9-9ab5-43809d2b16e9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:07.349708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029901c-ea35-45f9-9ab5-43809d2b16e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:07.375172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029901c-ea35-45f9-9ab5-43809d2b16e9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:07.390373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-f029901c-ea35-45f9-9ab5-43809d2b16e9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:07.391496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 277/552] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:07.397742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2c5fe-8654-4a45-ae60-d85f95c22bc7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:07.407218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2c5fe-8654-4a45-ae60-d85f95c22bc7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:07.412432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6d328-14ab-41a6-952b-de116ce8701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:07.413024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d328-14ab-41a6-952b-de116ce8701f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:07.413308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d328-14ab-41a6-952b-de116ce8701f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:07.413568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d328-14ab-41a6-952b-de116ce8701f admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:07.414372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6d328-14ab-41a6-952b-de116ce8701f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:07.414670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6d328-14ab-41a6-952b-de116ce8701f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:07.440966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6d328-14ab-41a6-952b-de116ce8701f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:07.455190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 276/553] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:07.461357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029901c-ea35-45f9-9ab5-43809d2b16e9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:07.471441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029901c-ea35-45f9-9ab5-43809d2b16e9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:07.476720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac522931-0a5e-4490-b5c0-6272e6d4972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:07.477539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522931-0a5e-4490-b5c0-6272e6d4972a admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:07.477817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522931-0a5e-4490-b5c0-6272e6d4972a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:07.478133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522931-0a5e-4490-b5c0-6272e6d4972a admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/0b797c99041b4e9c9cde7d0064013fda/roles/26d42daa051b453488fbaac4330bd6ab` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:07.499981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac522931-0a5e-4490-b5c0-6272e6d4972a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=0b797c99041b4e9c9cde7d0064013fda, role_id=26d42daa051b453488fbaac4330bd6ab)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:07.526140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac522931-0a5e-4490-b5c0-6272e6d4972a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:07.540853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 278/554] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:07 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/0b797c99041b4e9c9cde7d0064013fda/roles/26d42daa051b453488fbaac4330bd6ab => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:09.501945 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da715f-a18e-42ba-a968-5388ef9eed24 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:09.502483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da715f-a18e-42ba-a968-5388ef9eed24 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:09.502483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da715f-a18e-42ba-a968-5388ef9eed24 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:09.504126 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 277/555] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:09.509336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b0962-60c4-4959-8593-dd53487cdd67 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:09.509774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b0962-60c4-4959-8593-dd53487cdd67 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:09.509862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b0962-60c4-4959-8593-dd53487cdd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:09.533700 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a31b0962-60c4-4959-8593-dd53487cdd67 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:09.534871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a31b0962-60c4-4959-8593-dd53487cdd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:09.605813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 279/556] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:09 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:09.629047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da715f-a18e-42ba-a968-5388ef9eed24 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:09.642706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da715f-a18e-42ba-a968-5388ef9eed24 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:09.647330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00ce09-9be1-47ec-bcab-e4ee9f25a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:09.648079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00ce09-9be1-47ec-bcab-e4ee9f25a623 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:09.648358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00ce09-9be1-47ec-bcab-e4ee9f25a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:09.648634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00ce09-9be1-47ec-bcab-e4ee9f25a623 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:09.660705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00ce09-9be1-47ec-bcab-e4ee9f25a623 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:09.667099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-fd00ce09-9be1-47ec-bcab-e4ee9f25a623 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:22:09.668228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 278/557] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:22:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:09.674915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b0962-60c4-4959-8593-dd53487cdd67 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:09.684310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b0962-60c4-4959-8593-dd53487cdd67 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:09.689800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb41c-3b4c-44d0-a136-6d95754f87a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:09.690455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb41c-3b4c-44d0-a136-6d95754f87a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:09.690744 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb41c-3b4c-44d0-a136-6d95754f87a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:09.691021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb41c-3b4c-44d0-a136-6d95754f87a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:09.691755 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb41c-3b4c-44d0-a136-6d95754f87a8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:09.692049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb41c-3b4c-44d0-a136-6d95754f87a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:09.717580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb41c-3b4c-44d0-a136-6d95754f87a8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:09.726717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 280/558] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:22:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:09.732559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00ce09-9be1-47ec-bcab-e4ee9f25a623 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:09.744997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00ce09-9be1-47ec-bcab-e4ee9f25a623 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:09.750087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378b62-77fd-4421-8157-1bdcf8f07c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:09.750807 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378b62-77fd-4421-8157-1bdcf8f07c9a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:09.751094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378b62-77fd-4421-8157-1bdcf8f07c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:09.751362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378b62-77fd-4421-8157-1bdcf8f07c9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:09.763659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6378b62-77fd-4421-8157-1bdcf8f07c9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:09.789093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6378b62-77fd-4421-8157-1bdcf8f07c9a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:09.807869 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-d6378b62-77fd-4421-8157-1bdcf8f07c9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:09.808989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 279/559] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:09.814950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb41c-3b4c-44d0-a136-6d95754f87a8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:09.824915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb41c-3b4c-44d0-a136-6d95754f87a8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:09.829942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05f9dd-3568-465c-8c13-9681ae241e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:09.830549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05f9dd-3568-465c-8c13-9681ae241e01 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:09.830859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05f9dd-3568-465c-8c13-9681ae241e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:09.831134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05f9dd-3568-465c-8c13-9681ae241e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:09.831832 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05f9dd-3568-465c-8c13-9681ae241e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:09.832131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05f9dd-3568-465c-8c13-9681ae241e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:09.857396 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05f9dd-3568-465c-8c13-9681ae241e01 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:09.871517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 281/560] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:09.877404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378b62-77fd-4421-8157-1bdcf8f07c9a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:09.887009 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378b62-77fd-4421-8157-1bdcf8f07c9a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:09.891476 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42950cc-d931-4778-b778-ca6cb5d71a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:09.892206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42950cc-d931-4778-b778-ca6cb5d71a80 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:09.892706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42950cc-d931-4778-b778-ca6cb5d71a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:09.893079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42950cc-d931-4778-b778-ca6cb5d71a80 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:09.906115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42950cc-d931-4778-b778-ca6cb5d71a80 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:09.932942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42950cc-d931-4778-b778-ca6cb5d71a80 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:09.952062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-c42950cc-d931-4778-b778-ca6cb5d71a80 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 16 14:22:09.953176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 280/561] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:09 2021] GET /identity/v3/users/glance => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:09.959343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05f9dd-3568-465c-8c13-9681ae241e01 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:09.969162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05f9dd-3568-465c-8c13-9681ae241e01 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:09.973752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d52286-9c35-4e74-a4ef-5df6400ebddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:09.974383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d52286-9c35-4e74-a4ef-5df6400ebddf admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:09.974670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d52286-9c35-4e74-a4ef-5df6400ebddf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:09.974948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d52286-9c35-4e74-a4ef-5df6400ebddf admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:09.975750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d52286-9c35-4e74-a4ef-5df6400ebddf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:09.976042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d52286-9c35-4e74-a4ef-5df6400ebddf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:10.001526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d52286-9c35-4e74-a4ef-5df6400ebddf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.031008 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 282/562] 10.222.0.67 () {56 vars in 1158 bytes} [Thu Dec 16 14:22:09 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:10.036929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42950cc-d931-4778-b778-ca6cb5d71a80 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.047098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42950cc-d931-4778-b778-ca6cb5d71a80 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.052805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d9eb2-cbb8-483c-8355-5a5816d8148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.053400 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d9eb2-cbb8-483c-8355-5a5816d8148d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.053682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d9eb2-cbb8-483c-8355-5a5816d8148d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.053958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d9eb2-cbb8-483c-8355-5a5816d8148d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.062550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d9eb2-cbb8-483c-8355-5a5816d8148d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:10.088104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d9eb2-cbb8-483c-8355-5a5816d8148d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.097465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 281/563] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:10.103337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d52286-9c35-4e74-a4ef-5df6400ebddf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.113036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d52286-9c35-4e74-a4ef-5df6400ebddf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.117565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c02da-09a3-430f-85fc-55da48c19df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.118362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c02da-09a3-430f-85fc-55da48c19df4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.118633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c02da-09a3-430f-85fc-55da48c19df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.118906 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c02da-09a3-430f-85fc-55da48c19df4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.131180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c02da-09a3-430f-85fc-55da48c19df4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:10.156803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c02da-09a3-430f-85fc-55da48c19df4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.175283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-704c02da-09a3-430f-85fc-55da48c19df4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:10.176464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 283/564] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:10.182286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d9eb2-cbb8-483c-8355-5a5816d8148d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.191465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d9eb2-cbb8-483c-8355-5a5816d8148d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.195933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a50d34-2f3e-4e39-b153-36eb0a5db4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.196524 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a50d34-2f3e-4e39-b153-36eb0a5db4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.196808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a50d34-2f3e-4e39-b153-36eb0a5db4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.197085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a50d34-2f3e-4e39-b153-36eb0a5db4f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.197767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a50d34-2f3e-4e39-b153-36eb0a5db4f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:10.198090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a50d34-2f3e-4e39-b153-36eb0a5db4f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:10.223649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a50d34-2f3e-4e39-b153-36eb0a5db4f6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.237346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 282/565] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:10.243193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c02da-09a3-430f-85fc-55da48c19df4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.253739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c02da-09a3-430f-85fc-55da48c19df4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.258593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ffa8e-8b9e-404a-8e8d-bfa9dfeb551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.259332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ffa8e-8b9e-404a-8e8d-bfa9dfeb551b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.259614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ffa8e-8b9e-404a-8e8d-bfa9dfeb551b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.259885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ffa8e-8b9e-404a-8e8d-bfa9dfeb551b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.269852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ffa8e-8b9e-404a-8e8d-bfa9dfeb551b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:10.296123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ffa8e-8b9e-404a-8e8d-bfa9dfeb551b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.311779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-973ffa8e-8b9e-404a-8e8d-bfa9dfeb551b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:10.312923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 284/566] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:10.321214 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a50d34-2f3e-4e39-b153-36eb0a5db4f6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.340574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a50d34-2f3e-4e39-b153-36eb0a5db4f6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.350499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d63d9c-cd35-4938-8f54-ca1980f18276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.351114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d63d9c-cd35-4938-8f54-ca1980f18276 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.351418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d63d9c-cd35-4938-8f54-ca1980f18276 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.351745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d63d9c-cd35-4938-8f54-ca1980f18276 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.352449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d63d9c-cd35-4938-8f54-ca1980f18276 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:10.352745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d63d9c-cd35-4938-8f54-ca1980f18276 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:10.379698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d63d9c-cd35-4938-8f54-ca1980f18276 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.394560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 283/567] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:10.400913 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ffa8e-8b9e-404a-8e8d-bfa9dfeb551b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:10.411831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ffa8e-8b9e-404a-8e8d-bfa9dfeb551b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:10.416439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f9b5-b43c-42f7-94d1-4caf0628fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:10.417027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f9b5-b43c-42f7-94d1-4caf0628fc2a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:10.417308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f9b5-b43c-42f7-94d1-4caf0628fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:10.417580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f9b5-b43c-42f7-94d1-4caf0628fc2a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:10.418408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71f9b5-b43c-42f7-94d1-4caf0628fc2a admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=0b797c99041b4e9c9cde7d0064013fda) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:10.418707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71f9b5-b43c-42f7-94d1-4caf0628fc2a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:10.444430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71f9b5-b43c-42f7-94d1-4caf0628fc2a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:10.450832 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 285/568] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:10 2021] GET /identity/v3/role_assignments?user.id=0b797c99041b4e9c9cde7d0064013fda&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:12.541366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dae0d-d5ac-4416-8e02-d07d90cf3b08 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.541965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dae0d-d5ac-4416-8e02-d07d90cf3b08 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.541965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dae0d-d5ac-4416-8e02-d07d90cf3b08 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.543508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 284/569] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:12.549447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade052-f7da-4691-adda-f4e650943d8c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.549898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade052-f7da-4691-adda-f4e650943d8c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.549898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade052-f7da-4691-adda-f4e650943d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.574113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-32ade052-f7da-4691-adda-f4e650943d8c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:12.575286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-32ade052-f7da-4691-adda-f4e650943d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:12.583699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 286/570] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:12 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:12.608235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dae0d-d5ac-4416-8e02-d07d90cf3b08 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:12.621729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dae0d-d5ac-4416-8e02-d07d90cf3b08 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:12.626647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9be90c-d501-4ecb-a351-6ca02e9781eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:12.627397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be90c-d501-4ecb-a351-6ca02e9781eb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.627678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be90c-d501-4ecb-a351-6ca02e9781eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.627956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be90c-d501-4ecb-a351-6ca02e9781eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.639782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9be90c-d501-4ecb-a351-6ca02e9781eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:12.666721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9be90c-d501-4ecb-a351-6ca02e9781eb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:12.686785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-1b9be90c-d501-4ecb-a351-6ca02e9781eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:12.687966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 285/571] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:12.694308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ade052-f7da-4691-adda-f4e650943d8c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:12.703470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ade052-f7da-4691-adda-f4e650943d8c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:12.709181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04805fd-3ed9-45e4-8e53-7292c26f5c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:12.709767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04805fd-3ed9-45e4-8e53-7292c26f5c19 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.710054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04805fd-3ed9-45e4-8e53-7292c26f5c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.710352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04805fd-3ed9-45e4-8e53-7292c26f5c19 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.711036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04805fd-3ed9-45e4-8e53-7292c26f5c19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:12.711334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04805fd-3ed9-45e4-8e53-7292c26f5c19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:12.737609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04805fd-3ed9-45e4-8e53-7292c26f5c19 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:12.751972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 287/572] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:12.757803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9be90c-d501-4ecb-a351-6ca02e9781eb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:12.768746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9be90c-d501-4ecb-a351-6ca02e9781eb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:12.773161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f706c-f7f9-425f-b391-59cbb67159ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:12.773759 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f706c-f7f9-425f-b391-59cbb67159ed admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:12.774069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f706c-f7f9-425f-b391-59cbb67159ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:12.774353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f706c-f7f9-425f-b391-59cbb67159ed admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:12.775027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f706c-f7f9-425f-b391-59cbb67159ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:12.802026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f706c-f7f9-425f-b391-59cbb67159ed admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:12.826591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 286/573] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:22:12 2021] POST /identity/v3/users => generated 254 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:22:14.832285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7425-b546-4213-bda0-1239947ae64c None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:14.832891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7425-b546-4213-bda0-1239947ae64c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:14.832891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7425-b546-4213-bda0-1239947ae64c None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:14.834578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 288/574] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:14.839889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303db69-655a-4361-a433-46a26242118d None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:14.840335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303db69-655a-4361-a433-46a26242118d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:14.840434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303db69-655a-4361-a433-46a26242118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:14.864036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3303db69-655a-4361-a433-46a26242118d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:14.865182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3303db69-655a-4361-a433-46a26242118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:14.872433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 287/575] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:14 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:14.895240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7425-b546-4213-bda0-1239947ae64c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:14.909132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7425-b546-4213-bda0-1239947ae64c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:14.914226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab03c-a82f-4583-b3ad-049d069bb657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:14.914949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab03c-a82f-4583-b3ad-049d069bb657 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:14.915228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab03c-a82f-4583-b3ad-049d069bb657 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:14.915498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab03c-a82f-4583-b3ad-049d069bb657 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:14.928325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dab03c-a82f-4583-b3ad-049d069bb657 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:14.934855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-f0dab03c-a82f-4583-b3ad-049d069bb657 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:22:14.935959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 289/576] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:22:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:14.942499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303db69-655a-4361-a433-46a26242118d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:14.951749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303db69-655a-4361-a433-46a26242118d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:14.957483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14957e79-9566-40a9-95e4-a8275eb6a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:14.958128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14957e79-9566-40a9-95e4-a8275eb6a8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:14.958410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14957e79-9566-40a9-95e4-a8275eb6a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:14.958684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14957e79-9566-40a9-95e4-a8275eb6a8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:14.959423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14957e79-9566-40a9-95e4-a8275eb6a8a2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:14.959714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14957e79-9566-40a9-95e4-a8275eb6a8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:14.985471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14957e79-9566-40a9-95e4-a8275eb6a8a2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:14.995309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 288/577] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:22:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:22:15.001292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab03c-a82f-4583-b3ad-049d069bb657 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.013686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab03c-a82f-4583-b3ad-049d069bb657 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.018595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afd059-d77d-4d01-b809-ac7e40f65337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.019323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afd059-d77d-4d01-b809-ac7e40f65337 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.019605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afd059-d77d-4d01-b809-ac7e40f65337 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.019885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afd059-d77d-4d01-b809-ac7e40f65337 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.031810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afd059-d77d-4d01-b809-ac7e40f65337 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.058513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afd059-d77d-4d01-b809-ac7e40f65337 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.078629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-f4afd059-d77d-4d01-b809-ac7e40f65337 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:15.079760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 290/578] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:15.086379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14957e79-9566-40a9-95e4-a8275eb6a8a2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.097616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14957e79-9566-40a9-95e4-a8275eb6a8a2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.105869 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4d729-533b-44ed-bdfc-530f018cc24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.106888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4d729-533b-44ed-bdfc-530f018cc24a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.107261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4d729-533b-44ed-bdfc-530f018cc24a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.107647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4d729-533b-44ed-bdfc-530f018cc24a admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.108710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4d729-533b-44ed-bdfc-530f018cc24a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:15.109172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4d729-533b-44ed-bdfc-530f018cc24a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.135602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4d729-533b-44ed-bdfc-530f018cc24a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.149747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 289/579] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:15.155562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afd059-d77d-4d01-b809-ac7e40f65337 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.165285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afd059-d77d-4d01-b809-ac7e40f65337 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.169737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66251a-1320-4052-8ed8-bb0e39a8c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.170516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66251a-1320-4052-8ed8-bb0e39a8c93c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.170795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66251a-1320-4052-8ed8-bb0e39a8c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.171070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66251a-1320-4052-8ed8-bb0e39a8c93c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.184427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66251a-1320-4052-8ed8-bb0e39a8c93c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.217513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66251a-1320-4052-8ed8-bb0e39a8c93c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.238945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-cd66251a-1320-4052-8ed8-bb0e39a8c93c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:22:15.240074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 291/580] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:15.246025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4d729-533b-44ed-bdfc-530f018cc24a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.256392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4d729-533b-44ed-bdfc-530f018cc24a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.261669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0ae17-d10a-4062-9f1a-531b4e06bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.262331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0ae17-d10a-4062-9f1a-531b4e06bf31 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.262611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0ae17-d10a-4062-9f1a-531b4e06bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.262883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0ae17-d10a-4062-9f1a-531b4e06bf31 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.265049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0ae17-d10a-4062-9f1a-531b4e06bf31 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:15.265049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0ae17-d10a-4062-9f1a-531b4e06bf31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.289500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0ae17-d10a-4062-9f1a-531b4e06bf31 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.319762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 290/581] 10.222.0.67 () {56 vars in 1170 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:15.328770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66251a-1320-4052-8ed8-bb0e39a8c93c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.344958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66251a-1320-4052-8ed8-bb0e39a8c93c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.350398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01f869-1dd0-4a76-8f3e-b2d6e712bdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.350978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01f869-1dd0-4a76-8f3e-b2d6e712bdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.351261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01f869-1dd0-4a76-8f3e-b2d6e712bdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.351520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01f869-1dd0-4a76-8f3e-b2d6e712bdf5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.360022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01f869-1dd0-4a76-8f3e-b2d6e712bdf5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.385500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01f869-1dd0-4a76-8f3e-b2d6e712bdf5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.395572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 292/582] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:15.402226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0ae17-d10a-4062-9f1a-531b4e06bf31 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.414509 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0ae17-d10a-4062-9f1a-531b4e06bf31 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.419118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ab40-b555-483d-9641-530b02beb8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.419840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ab40-b555-483d-9641-530b02beb8cb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.420117 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ab40-b555-483d-9641-530b02beb8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.420386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ab40-b555-483d-9641-530b02beb8cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.433734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ab40-b555-483d-9641-530b02beb8cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.459785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ab40-b555-483d-9641-530b02beb8cb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.479534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-f846ab40-b555-483d-9641-530b02beb8cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:15.480779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 291/583] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:15.487336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01f869-1dd0-4a76-8f3e-b2d6e712bdf5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.496751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01f869-1dd0-4a76-8f3e-b2d6e712bdf5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.502418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00f55b-58be-48d5-9dae-be7ba6bbb9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.503036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f55b-58be-48d5-9dae-be7ba6bbb9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.503316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f55b-58be-48d5-9dae-be7ba6bbb9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.503587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f55b-58be-48d5-9dae-be7ba6bbb9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.504301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00f55b-58be-48d5-9dae-be7ba6bbb9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:15.504590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00f55b-58be-48d5-9dae-be7ba6bbb9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.529975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00f55b-58be-48d5-9dae-be7ba6bbb9d4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.544523 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 293/584] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:15.550968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ab40-b555-483d-9641-530b02beb8cb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.561513 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ab40-b555-483d-9641-530b02beb8cb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.567017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08993807-46be-4612-adcc-ce8f95f5a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.567760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08993807-46be-4612-adcc-ce8f95f5a3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.568037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08993807-46be-4612-adcc-ce8f95f5a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.568307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08993807-46be-4612-adcc-ce8f95f5a3f0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.580178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08993807-46be-4612-adcc-ce8f95f5a3f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.605864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08993807-46be-4612-adcc-ce8f95f5a3f0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.621201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-08993807-46be-4612-adcc-ce8f95f5a3f0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:15.622367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 292/585] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:15.628598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00f55b-58be-48d5-9dae-be7ba6bbb9d4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.638704 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00f55b-58be-48d5-9dae-be7ba6bbb9d4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.643443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f76e0-357a-41be-8d80-abd0c26b9cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.644079 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f76e0-357a-41be-8d80-abd0c26b9cca admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.644364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f76e0-357a-41be-8d80-abd0c26b9cca admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.644639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f76e0-357a-41be-8d80-abd0c26b9cca admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.645397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f76e0-357a-41be-8d80-abd0c26b9cca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:15.645698 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f76e0-357a-41be-8d80-abd0c26b9cca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.671128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f76e0-357a-41be-8d80-abd0c26b9cca admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.685858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 294/586] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:15.692400 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08993807-46be-4612-adcc-ce8f95f5a3f0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:15.702659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08993807-46be-4612-adcc-ce8f95f5a3f0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:15.707873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67f232-a10a-4f53-be01-0697065fbd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:15.708632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67f232-a10a-4f53-be01-0697065fbd35 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:15.709030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67f232-a10a-4f53-be01-0697065fbd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:15.709310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67f232-a10a-4f53-be01-0697065fbd35 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:15.710250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67f232-a10a-4f53-be01-0697065fbd35 admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=64742f0f7cf443f3ac3cc5505db446eb) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:15.714054 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67f232-a10a-4f53-be01-0697065fbd35 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:15.739727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67f232-a10a-4f53-be01-0697065fbd35 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:15.745961 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 293/587] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:15 2021] GET /identity/v3/role_assignments?user.id=64742f0f7cf443f3ac3cc5505db446eb&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:17.724500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a17f4-8e8e-49e7-8f94-f1111046da37 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.725061 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a17f4-8e8e-49e7-8f94-f1111046da37 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.725061 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a17f4-8e8e-49e7-8f94-f1111046da37 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.727021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 295/588] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:17.732427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cf3a-6e46-4094-bc83-0ed232eb26f4 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.732907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cf3a-6e46-4094-bc83-0ed232eb26f4 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.732995 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cf3a-6e46-4094-bc83-0ed232eb26f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.759536 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c9b4cf3a-6e46-4094-bc83-0ed232eb26f4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:17.760763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c9b4cf3a-6e46-4094-bc83-0ed232eb26f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:17.768055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 294/589] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:17 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:17.792823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a17f4-8e8e-49e7-8f94-f1111046da37 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:17.807719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a17f4-8e8e-49e7-8f94-f1111046da37 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:17.812872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4762e5-4657-4de9-a26a-446d5664d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:17.813629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4762e5-4657-4de9-a26a-446d5664d8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.813914 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4762e5-4657-4de9-a26a-446d5664d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.814252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4762e5-4657-4de9-a26a-446d5664d8b2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.828133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4762e5-4657-4de9-a26a-446d5664d8b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:17.835288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-fd4762e5-4657-4de9-a26a-446d5664d8b2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:22:17.836497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 296/590] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:17.842939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4cf3a-6e46-4094-bc83-0ed232eb26f4 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:17.853041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4cf3a-6e46-4094-bc83-0ed232eb26f4 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:17.858434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df12b5-5911-4f1c-9c66-6ac533c4cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:17.859046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df12b5-5911-4f1c-9c66-6ac533c4cd46 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.859379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df12b5-5911-4f1c-9c66-6ac533c4cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.859629 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df12b5-5911-4f1c-9c66-6ac533c4cd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.860321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df12b5-5911-4f1c-9c66-6ac533c4cd46 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:17.860611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df12b5-5911-4f1c-9c66-6ac533c4cd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:17.886848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df12b5-5911-4f1c-9c66-6ac533c4cd46 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:17.896942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 295/591] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:17.903250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4762e5-4657-4de9-a26a-446d5664d8b2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:17.919123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4762e5-4657-4de9-a26a-446d5664d8b2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:17.926898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef7ff4-5db9-45fa-bb75-e2600ca4223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:17.927620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef7ff4-5db9-45fa-bb75-e2600ca4223d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:17.927897 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef7ff4-5db9-45fa-bb75-e2600ca4223d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:17.928161 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef7ff4-5db9-45fa-bb75-e2600ca4223d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:17.941345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef7ff4-5db9-45fa-bb75-e2600ca4223d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:17.967549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef7ff4-5db9-45fa-bb75-e2600ca4223d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:17.987608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-ddef7ff4-5db9-45fa-bb75-e2600ca4223d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:17.988692 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 297/592] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:17.994576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df12b5-5911-4f1c-9c66-6ac533c4cd46 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:18.005335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df12b5-5911-4f1c-9c66-6ac533c4cd46 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:18.010261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653b4b6-5178-4d98-8403-4f018f4543a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:18.010862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653b4b6-5178-4d98-8403-4f018f4543a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:18.011144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653b4b6-5178-4d98-8403-4f018f4543a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:18.011429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653b4b6-5178-4d98-8403-4f018f4543a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:18.012141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653b4b6-5178-4d98-8403-4f018f4543a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:18.012446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653b4b6-5178-4d98-8403-4f018f4543a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:18.038774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653b4b6-5178-4d98-8403-4f018f4543a7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:18.054121 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 296/593] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:18.059888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef7ff4-5db9-45fa-bb75-e2600ca4223d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:18.069275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef7ff4-5db9-45fa-bb75-e2600ca4223d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:18.073697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bc3f7-427d-4570-9fc4-0aa7574ff003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:18.074474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bc3f7-427d-4570-9fc4-0aa7574ff003 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:18.074747 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bc3f7-427d-4570-9fc4-0aa7574ff003 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:18.075017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bc3f7-427d-4570-9fc4-0aa7574ff003 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:18.088450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bc3f7-427d-4570-9fc4-0aa7574ff003 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:18.114328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bc3f7-427d-4570-9fc4-0aa7574ff003 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:18.134084 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-c44bc3f7-427d-4570-9fc4-0aa7574ff003 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:22:18.135243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 298/594] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:22:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:18.141076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653b4b6-5178-4d98-8403-4f018f4543a7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:18.151580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653b4b6-5178-4d98-8403-4f018f4543a7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:18.156520 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c901e-7873-4bdc-9889-4a2538a2043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:18.157142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c901e-7873-4bdc-9889-4a2538a2043c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:18.157423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c901e-7873-4bdc-9889-4a2538a2043c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:18.157705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c901e-7873-4bdc-9889-4a2538a2043c admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:18.158594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c901e-7873-4bdc-9889-4a2538a2043c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:18.158899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c901e-7873-4bdc-9889-4a2538a2043c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:18.185151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c901e-7873-4bdc-9889-4a2538a2043c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:18.215012 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 297/595] 10.222.0.67 () {56 vars in 1170 bytes} [Thu Dec 16 14:22:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:18.221092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bc3f7-427d-4570-9fc4-0aa7574ff003 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:18.231039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bc3f7-427d-4570-9fc4-0aa7574ff003 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:18.236369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe147b-187e-4169-97e6-f44aef3be051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:18.238507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe147b-187e-4169-97e6-f44aef3be051 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:18.238507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe147b-187e-4169-97e6-f44aef3be051 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:18.238507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe147b-187e-4169-97e6-f44aef3be051 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:18.251432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe147b-187e-4169-97e6-f44aef3be051 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:18.280400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe147b-187e-4169-97e6-f44aef3be051 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:18.298693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-c8fe147b-187e-4169-97e6-f44aef3be051 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:18.299855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 299/596] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:18.307589 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c901e-7873-4bdc-9889-4a2538a2043c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:18.317485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c901e-7873-4bdc-9889-4a2538a2043c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:18.322025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600916e-2e61-4e37-99d4-3e57ea758c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:18.322654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600916e-2e61-4e37-99d4-3e57ea758c44 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:18.322941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600916e-2e61-4e37-99d4-3e57ea758c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:18.323225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600916e-2e61-4e37-99d4-3e57ea758c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:18.323941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600916e-2e61-4e37-99d4-3e57ea758c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:18.324246 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600916e-2e61-4e37-99d4-3e57ea758c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:18.352967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600916e-2e61-4e37-99d4-3e57ea758c44 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:18.366121 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 298/597] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:22:18.371899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe147b-187e-4169-97e6-f44aef3be051 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:18.381933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe147b-187e-4169-97e6-f44aef3be051 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:18.386863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5f222-c1a9-4ec4-a007-6f54a5d8180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:18.387587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5f222-c1a9-4ec4-a007-6f54a5d8180c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:18.387868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5f222-c1a9-4ec4-a007-6f54a5d8180c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:18.388140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5f222-c1a9-4ec4-a007-6f54a5d8180c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:18.397821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5f222-c1a9-4ec4-a007-6f54a5d8180c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:18.426724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5f222-c1a9-4ec4-a007-6f54a5d8180c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:18.441923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-44b5f222-c1a9-4ec4-a007-6f54a5d8180c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:18.443100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 300/598] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:18.449124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600916e-2e61-4e37-99d4-3e57ea758c44 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:18.459243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600916e-2e61-4e37-99d4-3e57ea758c44 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:18.464059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9348031-113f-40b4-bc64-9759012cbc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:18.464649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9348031-113f-40b4-bc64-9759012cbc75 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:18.464931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9348031-113f-40b4-bc64-9759012cbc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:18.465212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9348031-113f-40b4-bc64-9759012cbc75 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:18.465952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9348031-113f-40b4-bc64-9759012cbc75 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:18.466287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9348031-113f-40b4-bc64-9759012cbc75 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:18.492143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9348031-113f-40b4-bc64-9759012cbc75 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:18.507876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 299/599] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:18.514033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5f222-c1a9-4ec4-a007-6f54a5d8180c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:18.524017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5f222-c1a9-4ec4-a007-6f54a5d8180c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:18.529297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53c880-f81a-46a8-ae5b-2b8672c6800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:18.530148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c880-f81a-46a8-ae5b-2b8672c6800b admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:18.530426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c880-f81a-46a8-ae5b-2b8672c6800b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:18.530699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c880-f81a-46a8-ae5b-2b8672c6800b admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/64742f0f7cf443f3ac3cc5505db446eb/roles/26d42daa051b453488fbaac4330bd6ab` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:18.552533 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53c880-f81a-46a8-ae5b-2b8672c6800b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=64742f0f7cf443f3ac3cc5505db446eb, role_id=26d42daa051b453488fbaac4330bd6ab)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:18.578858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53c880-f81a-46a8-ae5b-2b8672c6800b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:18.593853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 301/600] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:18 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/64742f0f7cf443f3ac3cc5505db446eb/roles/26d42daa051b453488fbaac4330bd6ab => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:20.536112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334a67-7fae-4d09-a98d-e7659566bda6 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:20.536639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334a67-7fae-4d09-a98d-e7659566bda6 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:20.536639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334a67-7fae-4d09-a98d-e7659566bda6 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.538518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 300/601] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:20.543776 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea30053-30fd-4228-a9da-891afd9ad321 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:20.544251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea30053-30fd-4228-a9da-891afd9ad321 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:20.544340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea30053-30fd-4228-a9da-891afd9ad321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.567722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-2ea30053-30fd-4228-a9da-891afd9ad321 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:20.568886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2ea30053-30fd-4228-a9da-891afd9ad321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:20.637032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 302/602] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:20 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:20.660693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7334a67-7fae-4d09-a98d-e7659566bda6 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:20.674434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7334a67-7fae-4d09-a98d-e7659566bda6 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:20.679166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664f0d6-8ba6-43d3-8990-15c62fe2d676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:20.679927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664f0d6-8ba6-43d3-8990-15c62fe2d676 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:20.680215 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664f0d6-8ba6-43d3-8990-15c62fe2d676 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:20.680497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664f0d6-8ba6-43d3-8990-15c62fe2d676 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.694375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664f0d6-8ba6-43d3-8990-15c62fe2d676 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:20.701098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-5664f0d6-8ba6-43d3-8990-15c62fe2d676 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:22:20.702323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 301/603] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:22:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:20.708854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea30053-30fd-4228-a9da-891afd9ad321 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:20.718265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea30053-30fd-4228-a9da-891afd9ad321 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:20.724301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ad86-7ea9-45bd-905c-1601fea2257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:20.724910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ad86-7ea9-45bd-905c-1601fea2257c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:20.725196 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ad86-7ea9-45bd-905c-1601fea2257c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:20.725467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ad86-7ea9-45bd-905c-1601fea2257c admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.726273 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18ad86-7ea9-45bd-905c-1601fea2257c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:20.726568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18ad86-7ea9-45bd-905c-1601fea2257c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:20.753095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18ad86-7ea9-45bd-905c-1601fea2257c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:20.762945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 303/604] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:22:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:20.769199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664f0d6-8ba6-43d3-8990-15c62fe2d676 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:20.780346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664f0d6-8ba6-43d3-8990-15c62fe2d676 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:20.785983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78634d89-9729-4911-95b5-d4b623cdcb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:20.786838 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78634d89-9729-4911-95b5-d4b623cdcb17 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:20.787053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78634d89-9729-4911-95b5-d4b623cdcb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:20.787325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78634d89-9729-4911-95b5-d4b623cdcb17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.803509 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78634d89-9729-4911-95b5-d4b623cdcb17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:20.826696 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78634d89-9729-4911-95b5-d4b623cdcb17 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:20.847522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-78634d89-9729-4911-95b5-d4b623cdcb17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:20.848667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 302/605] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:20.854681 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ad86-7ea9-45bd-905c-1601fea2257c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:20.865411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ad86-7ea9-45bd-905c-1601fea2257c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:20.870509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14a692-d366-4578-9826-60c7ca03788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:20.871105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14a692-d366-4578-9826-60c7ca03788e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:20.871420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14a692-d366-4578-9826-60c7ca03788e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:20.871671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14a692-d366-4578-9826-60c7ca03788e admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.872357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14a692-d366-4578-9826-60c7ca03788e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:20.872658 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14a692-d366-4578-9826-60c7ca03788e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:20.898170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14a692-d366-4578-9826-60c7ca03788e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:20.911771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 304/606] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:20.917524 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78634d89-9729-4911-95b5-d4b623cdcb17 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:20.928218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78634d89-9729-4911-95b5-d4b623cdcb17 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:20.932743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d874d9-eaa5-43f6-84ab-473539e08bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:20.933480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d874d9-eaa5-43f6-84ab-473539e08bcb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:20.933764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d874d9-eaa5-43f6-84ab-473539e08bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:20.934042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d874d9-eaa5-43f6-84ab-473539e08bcb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:20.947667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d874d9-eaa5-43f6-84ab-473539e08bcb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:20.973478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d874d9-eaa5-43f6-84ab-473539e08bcb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:20.992718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-54d874d9-eaa5-43f6-84ab-473539e08bcb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:22:20.993846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 303/607] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:22:20 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:20.999727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14a692-d366-4578-9826-60c7ca03788e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:21.009397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14a692-d366-4578-9826-60c7ca03788e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:21.014008 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9eba-8032-4106-b5ae-0842bbc9fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:21.014602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9eba-8032-4106-b5ae-0842bbc9fb70 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:21.014891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9eba-8032-4106-b5ae-0842bbc9fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:21.015169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9eba-8032-4106-b5ae-0842bbc9fb70 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:21.015968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c9eba-8032-4106-b5ae-0842bbc9fb70 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:21.016267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c9eba-8032-4106-b5ae-0842bbc9fb70 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:21.041842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c9eba-8032-4106-b5ae-0842bbc9fb70 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:21.071284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 305/608] 10.222.0.67 () {56 vars in 1170 bytes} [Thu Dec 16 14:22:20 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:21.077205 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d874d9-eaa5-43f6-84ab-473539e08bcb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:21.087845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d874d9-eaa5-43f6-84ab-473539e08bcb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:21.093168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49765bb6-c802-4953-8277-8b5ec970b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:21.093762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49765bb6-c802-4953-8277-8b5ec970b8bb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:21.094089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49765bb6-c802-4953-8277-8b5ec970b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:21.094367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49765bb6-c802-4953-8277-8b5ec970b8bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:21.102941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49765bb6-c802-4953-8277-8b5ec970b8bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:21.129458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49765bb6-c802-4953-8277-8b5ec970b8bb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:21.138165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 304/609] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:21 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:21.144171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9eba-8032-4106-b5ae-0842bbc9fb70 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:21.154006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9eba-8032-4106-b5ae-0842bbc9fb70 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:21.159053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943536d5-2e84-44b2-9b60-ad0dd345fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:21.159788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943536d5-2e84-44b2-9b60-ad0dd345fae2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:21.160071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943536d5-2e84-44b2-9b60-ad0dd345fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:21.160346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943536d5-2e84-44b2-9b60-ad0dd345fae2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:21.172830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943536d5-2e84-44b2-9b60-ad0dd345fae2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:21.199120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943536d5-2e84-44b2-9b60-ad0dd345fae2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:21.217267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-943536d5-2e84-44b2-9b60-ad0dd345fae2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:21.218414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 306/610] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:21.224398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49765bb6-c802-4953-8277-8b5ec970b8bb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:21.233347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49765bb6-c802-4953-8277-8b5ec970b8bb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:21.238633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07283c0-047c-40cb-a27a-752ac495c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:21.239215 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07283c0-047c-40cb-a27a-752ac495c24a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:21.239497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07283c0-047c-40cb-a27a-752ac495c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:21.239773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07283c0-047c-40cb-a27a-752ac495c24a admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:21.240453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07283c0-047c-40cb-a27a-752ac495c24a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:21.240748 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07283c0-047c-40cb-a27a-752ac495c24a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:21.266173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07283c0-047c-40cb-a27a-752ac495c24a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:21.280680 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 305/611] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:21.286761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943536d5-2e84-44b2-9b60-ad0dd345fae2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:21.296863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943536d5-2e84-44b2-9b60-ad0dd345fae2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:21.302379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aadad5-062e-43bc-96f6-387ba11ea1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:21.303085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aadad5-062e-43bc-96f6-387ba11ea1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:21.303362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aadad5-062e-43bc-96f6-387ba11ea1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:21.303629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aadad5-062e-43bc-96f6-387ba11ea1a3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:21.313499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aadad5-062e-43bc-96f6-387ba11ea1a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:21.339366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aadad5-062e-43bc-96f6-387ba11ea1a3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:21.354028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-29aadad5-062e-43bc-96f6-387ba11ea1a3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:21.355143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 307/612] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:21.361121 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07283c0-047c-40cb-a27a-752ac495c24a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:21.371198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07283c0-047c-40cb-a27a-752ac495c24a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:21.376492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03794bbe-d6b2-4c46-b452-26f6a075643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:21.377076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03794bbe-d6b2-4c46-b452-26f6a075643d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:21.377365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03794bbe-d6b2-4c46-b452-26f6a075643d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:21.377693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03794bbe-d6b2-4c46-b452-26f6a075643d admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:21.378476 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03794bbe-d6b2-4c46-b452-26f6a075643d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:21.378771 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03794bbe-d6b2-4c46-b452-26f6a075643d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:21.404424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03794bbe-d6b2-4c46-b452-26f6a075643d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:21.418319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 306/613] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:21.424739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aadad5-062e-43bc-96f6-387ba11ea1a3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:21.434662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aadad5-062e-43bc-96f6-387ba11ea1a3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:21.440097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a68a4-674a-4774-85cf-afd33bdcb1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:21.440821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a68a4-674a-4774-85cf-afd33bdcb1ed admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:21.441185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a68a4-674a-4774-85cf-afd33bdcb1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:21.441561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a68a4-674a-4774-85cf-afd33bdcb1ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:21.442433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a68a4-674a-4774-85cf-afd33bdcb1ed admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=64742f0f7cf443f3ac3cc5505db446eb) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:21.442884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a68a4-674a-4774-85cf-afd33bdcb1ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:21.468363 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a68a4-674a-4774-85cf-afd33bdcb1ed admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:21.475372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 308/614] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:21 2021] GET /identity/v3/role_assignments?user.id=64742f0f7cf443f3ac3cc5505db446eb&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:23.537581 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44028e3-4ac0-436a-9f99-bdf4a3f2d21a None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:23.538443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44028e3-4ac0-436a-9f99-bdf4a3f2d21a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:23.538443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44028e3-4ac0-436a-9f99-bdf4a3f2d21a None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:23.540884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 307/615] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:23.549246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664183f7-31aa-406a-8020-6e3c5df5d5ea None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:23.549880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664183f7-31aa-406a-8020-6e3c5df5d5ea None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:23.549880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664183f7-31aa-406a-8020-6e3c5df5d5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:23.573727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-664183f7-31aa-406a-8020-6e3c5df5d5ea None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:23.574927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-664183f7-31aa-406a-8020-6e3c5df5d5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:23.582240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 309/616] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:23 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:23.605559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44028e3-4ac0-436a-9f99-bdf4a3f2d21a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:23.620818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44028e3-4ac0-436a-9f99-bdf4a3f2d21a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:23.627824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd99c7-0464-4a2e-a19b-3004dda6d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:23.628597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd99c7-0464-4a2e-a19b-3004dda6d36a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:23.628877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd99c7-0464-4a2e-a19b-3004dda6d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:23.629207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd99c7-0464-4a2e-a19b-3004dda6d36a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:23.642570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd99c7-0464-4a2e-a19b-3004dda6d36a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:23.649975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-fadd99c7-0464-4a2e-a19b-3004dda6d36a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:22:23.651244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 308/617] 10.222.0.67 () {56 vars in 1141 bytes} [Thu Dec 16 14:22:23 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:23.657876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664183f7-31aa-406a-8020-6e3c5df5d5ea None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:23.668118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664183f7-31aa-406a-8020-6e3c5df5d5ea None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:23.673760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0b164-df42-42a4-8bda-349f02083b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:23.674532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b164-df42-42a4-8bda-349f02083b2a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:23.674931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b164-df42-42a4-8bda-349f02083b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:23.675300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b164-df42-42a4-8bda-349f02083b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:23.676013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0b164-df42-42a4-8bda-349f02083b2a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:23.676301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0b164-df42-42a4-8bda-349f02083b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:23.701811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0b164-df42-42a4-8bda-349f02083b2a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:23.712038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 310/618] 10.222.0.67 () {56 vars in 1136 bytes} [Thu Dec 16 14:22:23 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:23.718109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd99c7-0464-4a2e-a19b-3004dda6d36a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:23.729126 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd99c7-0464-4a2e-a19b-3004dda6d36a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:23.734658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb7f2-f3a0-41b6-b788-30fb73470073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:23.735417 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb7f2-f3a0-41b6-b788-30fb73470073 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:23.735700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb7f2-f3a0-41b6-b788-30fb73470073 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:23.735981 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb7f2-f3a0-41b6-b788-30fb73470073 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:23.749143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bb7f2-f3a0-41b6-b788-30fb73470073 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:23.775411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bb7f2-f3a0-41b6-b788-30fb73470073 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:23.796869 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-345bb7f2-f3a0-41b6-b788-30fb73470073 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:23.797932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 309/619] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:23.806591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0b164-df42-42a4-8bda-349f02083b2a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:23.819862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0b164-df42-42a4-8bda-349f02083b2a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:23.825131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de9e2f-1511-4462-885e-72c2c7f2959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:23.825711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de9e2f-1511-4462-885e-72c2c7f2959b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:23.826006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de9e2f-1511-4462-885e-72c2c7f2959b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:23.826295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de9e2f-1511-4462-885e-72c2c7f2959b admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:23.826977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de9e2f-1511-4462-885e-72c2c7f2959b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:23.827269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de9e2f-1511-4462-885e-72c2c7f2959b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:23.853380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de9e2f-1511-4462-885e-72c2c7f2959b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:23.867142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 311/620] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:23.872999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb7f2-f3a0-41b6-b788-30fb73470073 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:23.883142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb7f2-f3a0-41b6-b788-30fb73470073 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:23.888382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c459-3dab-49b3-ab11-eec7137f6177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:23.889122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c459-3dab-49b3-ab11-eec7137f6177 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:23.889398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c459-3dab-49b3-ab11-eec7137f6177 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:23.889651 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c459-3dab-49b3-ab11-eec7137f6177 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:23.903466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1c459-3dab-49b3-ab11-eec7137f6177 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:23.929458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1c459-3dab-49b3-ab11-eec7137f6177 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:23.948305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-4ee1c459-3dab-49b3-ab11-eec7137f6177 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:22:23.949411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 310/621] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:22:23 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:23.955333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de9e2f-1511-4462-885e-72c2c7f2959b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:23.965327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de9e2f-1511-4462-885e-72c2c7f2959b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:23.969805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5e92c-e8df-4c32-a10d-7d00fc8797d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:23.970426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5e92c-e8df-4c32-a10d-7d00fc8797d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:23.970698 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5e92c-e8df-4c32-a10d-7d00fc8797d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:23.970955 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5e92c-e8df-4c32-a10d-7d00fc8797d3 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:23.971870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5e92c-e8df-4c32-a10d-7d00fc8797d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:23.972229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5e92c-e8df-4c32-a10d-7d00fc8797d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:23.997861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5e92c-e8df-4c32-a10d-7d00fc8797d3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.027264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 312/622] 10.222.0.67 () {56 vars in 1170 bytes} [Thu Dec 16 14:22:23 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:24.033191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c459-3dab-49b3-ab11-eec7137f6177 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.043377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c459-3dab-49b3-ab11-eec7137f6177 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.049077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e9a5-54a3-4f55-b075-e8b47cf74788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.049807 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e9a5-54a3-4f55-b075-e8b47cf74788 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.050312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e9a5-54a3-4f55-b075-e8b47cf74788 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.050603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e9a5-54a3-4f55-b075-e8b47cf74788 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.059111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039e9a5-54a3-4f55-b075-e8b47cf74788 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:24.085278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039e9a5-54a3-4f55-b075-e8b47cf74788 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.093814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 311/623] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:24.100183 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5e92c-e8df-4c32-a10d-7d00fc8797d3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.109855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5e92c-e8df-4c32-a10d-7d00fc8797d3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.114588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215d28c-2521-4b1f-a17e-166b4406eb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.115306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215d28c-2521-4b1f-a17e-166b4406eb8f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.115600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215d28c-2521-4b1f-a17e-166b4406eb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.115878 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215d28c-2521-4b1f-a17e-166b4406eb8f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.127620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215d28c-2521-4b1f-a17e-166b4406eb8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:24.153888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215d28c-2521-4b1f-a17e-166b4406eb8f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.171941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-8215d28c-2521-4b1f-a17e-166b4406eb8f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:24.173064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 313/624] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:24.179626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e9a5-54a3-4f55-b075-e8b47cf74788 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.188497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e9a5-54a3-4f55-b075-e8b47cf74788 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.193569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e06fb-d4ca-41f5-9dbd-f1a5fa5dcf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.194227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e06fb-d4ca-41f5-9dbd-f1a5fa5dcf0c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.194513 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e06fb-d4ca-41f5-9dbd-f1a5fa5dcf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.194793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e06fb-d4ca-41f5-9dbd-f1a5fa5dcf0c admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.195489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e06fb-d4ca-41f5-9dbd-f1a5fa5dcf0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:24.195791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e06fb-d4ca-41f5-9dbd-f1a5fa5dcf0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:24.221200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e06fb-d4ca-41f5-9dbd-f1a5fa5dcf0c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.234717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 312/625] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:24.240736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215d28c-2521-4b1f-a17e-166b4406eb8f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.250522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215d28c-2521-4b1f-a17e-166b4406eb8f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.255243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea831d-af2f-4b50-81f9-b709a396a3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.255979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea831d-af2f-4b50-81f9-b709a396a3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.256398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea831d-af2f-4b50-81f9-b709a396a3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.256648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea831d-af2f-4b50-81f9-b709a396a3b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.267717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea831d-af2f-4b50-81f9-b709a396a3b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:24.293530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea831d-af2f-4b50-81f9-b709a396a3b1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.308519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-6eea831d-af2f-4b50-81f9-b709a396a3b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:24.309551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 314/626] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:24.315952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e06fb-d4ca-41f5-9dbd-f1a5fa5dcf0c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.325956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e06fb-d4ca-41f5-9dbd-f1a5fa5dcf0c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.331225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a9ee4-2c82-410b-99de-f98efffd0037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.331693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a9ee4-2c82-410b-99de-f98efffd0037 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.331987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a9ee4-2c82-410b-99de-f98efffd0037 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.332264 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a9ee4-2c82-410b-99de-f98efffd0037 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.333026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a9ee4-2c82-410b-99de-f98efffd0037 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:24.333337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a9ee4-2c82-410b-99de-f98efffd0037 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:24.359302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a9ee4-2c82-410b-99de-f98efffd0037 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.374092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 313/627] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:24.380926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea831d-af2f-4b50-81f9-b709a396a3b1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:24.390919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea831d-af2f-4b50-81f9-b709a396a3b1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:24.395939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2427643-94ae-40d0-90b8-01ffaa0023b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:24.396545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427643-94ae-40d0-90b8-01ffaa0023b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:24.396824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427643-94ae-40d0-90b8-01ffaa0023b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:24.397094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427643-94ae-40d0-90b8-01ffaa0023b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:24.397880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2427643-94ae-40d0-90b8-01ffaa0023b1 admin admin] RBAC: Adding query filter params (role.id=967b4cdf1e1f4431bd33c4e43e06506f, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=64742f0f7cf443f3ac3cc5505db446eb) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:24.398209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2427643-94ae-40d0-90b8-01ffaa0023b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:24.424534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2427643-94ae-40d0-90b8-01ffaa0023b1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:24.431221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 315/628] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:24 2021] GET /identity/v3/role_assignments?user.id=64742f0f7cf443f3ac3cc5505db446eb&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=967b4cdf1e1f4431bd33c4e43e06506f => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:26.374142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcf99c-08db-4f89-b7b2-262a8aded1d6 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.374745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcf99c-08db-4f89-b7b2-262a8aded1d6 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.374745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcf99c-08db-4f89-b7b2-262a8aded1d6 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.376422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 314/629] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:26.382465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe587d6-d7f5-4cf3-a3ef-4a4c5dfc0a11 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.382901 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe587d6-d7f5-4cf3-a3ef-4a4c5dfc0a11 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.383000 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe587d6-d7f5-4cf3-a3ef-4a4c5dfc0a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.406677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-afe587d6-d7f5-4cf3-a3ef-4a4c5dfc0a11 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:26.407737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-afe587d6-d7f5-4cf3-a3ef-4a4c5dfc0a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:26.415098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 316/630] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:26 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:26.437334 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcf99c-08db-4f89-b7b2-262a8aded1d6 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.450500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcf99c-08db-4f89-b7b2-262a8aded1d6 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.455173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748a103-342d-4f40-b9db-9bdb16c6d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.456001 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748a103-342d-4f40-b9db-9bdb16c6d1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.456320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748a103-342d-4f40-b9db-9bdb16c6d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.456636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748a103-342d-4f40-b9db-9bdb16c6d1d2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.468952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748a103-342d-4f40-b9db-9bdb16c6d1d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:26.476213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-0748a103-342d-4f40-b9db-9bdb16c6d1d2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:22:26.477383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 315/631] 10.222.0.67 () {56 vars in 1141 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:26.483751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe587d6-d7f5-4cf3-a3ef-4a4c5dfc0a11 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.492494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe587d6-d7f5-4cf3-a3ef-4a4c5dfc0a11 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.496692 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a29fb-b66c-4d50-8e38-02f6eaaa150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.497275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a29fb-b66c-4d50-8e38-02f6eaaa150e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.497555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a29fb-b66c-4d50-8e38-02f6eaaa150e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.497823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a29fb-b66c-4d50-8e38-02f6eaaa150e admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.498570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a29fb-b66c-4d50-8e38-02f6eaaa150e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:26.498856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a29fb-b66c-4d50-8e38-02f6eaaa150e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:26.527441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a29fb-b66c-4d50-8e38-02f6eaaa150e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:26.543415 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 317/632] 10.222.0.67 () {56 vars in 1136 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:26.550669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748a103-342d-4f40-b9db-9bdb16c6d1d2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.568127 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748a103-342d-4f40-b9db-9bdb16c6d1d2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.572952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10486fe7-51f9-4800-8a9a-5f010d9657c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.573712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486fe7-51f9-4800-8a9a-5f010d9657c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.573954 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486fe7-51f9-4800-8a9a-5f010d9657c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.574305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486fe7-51f9-4800-8a9a-5f010d9657c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.594169 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10486fe7-51f9-4800-8a9a-5f010d9657c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:26.624254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10486fe7-51f9-4800-8a9a-5f010d9657c5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:26.646687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-10486fe7-51f9-4800-8a9a-5f010d9657c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:26.647907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 316/633] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:26.654034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a29fb-b66c-4d50-8e38-02f6eaaa150e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.665641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a29fb-b66c-4d50-8e38-02f6eaaa150e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.670094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb20c5a-4320-4fde-a9eb-a76de2f355d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.670709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb20c5a-4320-4fde-a9eb-a76de2f355d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.670996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb20c5a-4320-4fde-a9eb-a76de2f355d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.671272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb20c5a-4320-4fde-a9eb-a76de2f355d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.671975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb20c5a-4320-4fde-a9eb-a76de2f355d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:26.672269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb20c5a-4320-4fde-a9eb-a76de2f355d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:26.699340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb20c5a-4320-4fde-a9eb-a76de2f355d9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:26.714483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 318/634] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:26.720891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10486fe7-51f9-4800-8a9a-5f010d9657c5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.730859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10486fe7-51f9-4800-8a9a-5f010d9657c5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.735683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31b1d-e8c6-4f51-93f2-5ace2f3f445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.736432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31b1d-e8c6-4f51-93f2-5ace2f3f445f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.736708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31b1d-e8c6-4f51-93f2-5ace2f3f445f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.736996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31b1d-e8c6-4f51-93f2-5ace2f3f445f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.750553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e31b1d-e8c6-4f51-93f2-5ace2f3f445f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:26.777944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e31b1d-e8c6-4f51-93f2-5ace2f3f445f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:26.798271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-c7e31b1d-e8c6-4f51-93f2-5ace2f3f445f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:22:26.799895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 317/635] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:26.806540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb20c5a-4320-4fde-a9eb-a76de2f355d9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.816986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb20c5a-4320-4fde-a9eb-a76de2f355d9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.822352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a7a9-bcf0-4e54-8f2c-96db3e9333cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.822945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a7a9-bcf0-4e54-8f2c-96db3e9333cd admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.823216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a7a9-bcf0-4e54-8f2c-96db3e9333cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.823499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a7a9-bcf0-4e54-8f2c-96db3e9333cd admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.824288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a7a9-bcf0-4e54-8f2c-96db3e9333cd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:26.824576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a7a9-bcf0-4e54-8f2c-96db3e9333cd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:26.850308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a7a9-bcf0-4e54-8f2c-96db3e9333cd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:26.879369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 319/636] 10.222.0.67 () {56 vars in 1170 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:26.885230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31b1d-e8c6-4f51-93f2-5ace2f3f445f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.895728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31b1d-e8c6-4f51-93f2-5ace2f3f445f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.901092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe43e-6fad-467c-93bc-7ad536954727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.901844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe43e-6fad-467c-93bc-7ad536954727 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.902150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe43e-6fad-467c-93bc-7ad536954727 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.902434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe43e-6fad-467c-93bc-7ad536954727 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.917039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afe43e-6fad-467c-93bc-7ad536954727 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:26.943766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afe43e-6fad-467c-93bc-7ad536954727 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:26.965658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-64afe43e-6fad-467c-93bc-7ad536954727 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:26.966830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 318/637] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:26.972785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a7a9-bcf0-4e54-8f2c-96db3e9333cd admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:26.982796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a7a9-bcf0-4e54-8f2c-96db3e9333cd admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:26.988368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468897c9-4507-4768-918c-dfc05104121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:26.988953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468897c9-4507-4768-918c-dfc05104121b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:26.989219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468897c9-4507-4768-918c-dfc05104121b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:26.989491 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468897c9-4507-4768-918c-dfc05104121b admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:26.990216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468897c9-4507-4768-918c-dfc05104121b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:26.990513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468897c9-4507-4768-918c-dfc05104121b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:27.015753 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468897c9-4507-4768-918c-dfc05104121b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:27.028537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 320/638] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:27.034846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe43e-6fad-467c-93bc-7ad536954727 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:27.044864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe43e-6fad-467c-93bc-7ad536954727 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:27.051189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88975fef-9635-4409-ae13-b0da80eb5e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:27.051929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88975fef-9635-4409-ae13-b0da80eb5e95 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:27.052207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88975fef-9635-4409-ae13-b0da80eb5e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:27.052480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88975fef-9635-4409-ae13-b0da80eb5e95 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:27.062361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88975fef-9635-4409-ae13-b0da80eb5e95 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:27.088745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88975fef-9635-4409-ae13-b0da80eb5e95 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:27.103310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-88975fef-9635-4409-ae13-b0da80eb5e95 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:27.104443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 319/639] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:27.110932 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468897c9-4507-4768-918c-dfc05104121b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:27.120907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468897c9-4507-4768-918c-dfc05104121b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:27.125933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f0877-a632-4d6c-99c5-8ca18940abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:27.126553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f0877-a632-4d6c-99c5-8ca18940abe3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:27.126834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f0877-a632-4d6c-99c5-8ca18940abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:27.127108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f0877-a632-4d6c-99c5-8ca18940abe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:27.127964 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f0877-a632-4d6c-99c5-8ca18940abe3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:27.128414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f0877-a632-4d6c-99c5-8ca18940abe3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:27.153761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f0877-a632-4d6c-99c5-8ca18940abe3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:27.167968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 321/640] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:27.174324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88975fef-9635-4409-ae13-b0da80eb5e95 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:27.184081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88975fef-9635-4409-ae13-b0da80eb5e95 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:27.188253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcb192-5387-4455-ac23-f06649bb7e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:27.189096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcb192-5387-4455-ac23-f06649bb7e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:27.189378 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcb192-5387-4455-ac23-f06649bb7e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:27.189657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcb192-5387-4455-ac23-f06649bb7e76 admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/64742f0f7cf443f3ac3cc5505db446eb/roles/967b4cdf1e1f4431bd33c4e43e06506f` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:27.192551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcb192-5387-4455-ac23-f06649bb7e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=64742f0f7cf443f3ac3cc5505db446eb, role_id=967b4cdf1e1f4431bd33c4e43e06506f)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:27.219361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcb192-5387-4455-ac23-f06649bb7e76 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:27.234870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 320/641] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:27 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/64742f0f7cf443f3ac3cc5505db446eb/roles/967b4cdf1e1f4431bd33c4e43e06506f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:29.203454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f9320-da8b-41e3-b788-73fd0940566a None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.204012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f9320-da8b-41e3-b788-73fd0940566a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.204012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f9320-da8b-41e3-b788-73fd0940566a None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.205690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 322/642] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:29.211202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666e2f9-9680-48f9-b457-59f04e40eb7c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.211652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666e2f9-9680-48f9-b457-59f04e40eb7c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.211765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666e2f9-9680-48f9-b457-59f04e40eb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.235929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-1666e2f9-9680-48f9-b457-59f04e40eb7c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:29.237082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1666e2f9-9680-48f9-b457-59f04e40eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:29.312915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 321/643] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:29 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:29.336069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f9320-da8b-41e3-b788-73fd0940566a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.348197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f9320-da8b-41e3-b788-73fd0940566a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.352056 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ed16-e76c-453b-b176-3484dec8dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.352859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ed16-e76c-453b-b176-3484dec8dd6a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.353127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ed16-e76c-453b-b176-3484dec8dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.353416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ed16-e76c-453b-b176-3484dec8dd6a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.364909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1ed16-e76c-453b-b176-3484dec8dd6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:29.371848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-96f1ed16-e76c-453b-b176-3484dec8dd6a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 16 14:22:29.372980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 323/644] 10.222.0.67 () {56 vars in 1141 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:29.379229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666e2f9-9680-48f9-b457-59f04e40eb7c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.389244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666e2f9-9680-48f9-b457-59f04e40eb7c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.395258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f520a5d-57c2-461a-8140-95b3a3eb0954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.395864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520a5d-57c2-461a-8140-95b3a3eb0954 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.396141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520a5d-57c2-461a-8140-95b3a3eb0954 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.396411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520a5d-57c2-461a-8140-95b3a3eb0954 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.397128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f520a5d-57c2-461a-8140-95b3a3eb0954 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:29.397420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f520a5d-57c2-461a-8140-95b3a3eb0954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:29.423331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f520a5d-57c2-461a-8140-95b3a3eb0954 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.433156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 322/645] 10.222.0.67 () {56 vars in 1136 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:29.439200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ed16-e76c-453b-b176-3484dec8dd6a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.451833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ed16-e76c-453b-b176-3484dec8dd6a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.459583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89799cb-e392-4498-b20d-1ed56449c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.460367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89799cb-e392-4498-b20d-1ed56449c305 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.460642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89799cb-e392-4498-b20d-1ed56449c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.460917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89799cb-e392-4498-b20d-1ed56449c305 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.474547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89799cb-e392-4498-b20d-1ed56449c305 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:29.500655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89799cb-e392-4498-b20d-1ed56449c305 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.520388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-d89799cb-e392-4498-b20d-1ed56449c305 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:29.521582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 324/646] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:29.527604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f520a5d-57c2-461a-8140-95b3a3eb0954 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.538555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f520a5d-57c2-461a-8140-95b3a3eb0954 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.544075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a756734-88ee-4c62-9ee3-0237dd8ffb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.544703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756734-88ee-4c62-9ee3-0237dd8ffb6b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.544988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756734-88ee-4c62-9ee3-0237dd8ffb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.545265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756734-88ee-4c62-9ee3-0237dd8ffb6b admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.545971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a756734-88ee-4c62-9ee3-0237dd8ffb6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:29.546305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a756734-88ee-4c62-9ee3-0237dd8ffb6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:29.572795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a756734-88ee-4c62-9ee3-0237dd8ffb6b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.588838 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 323/647] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:29.595558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89799cb-e392-4498-b20d-1ed56449c305 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.605595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89799cb-e392-4498-b20d-1ed56449c305 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.610966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a6baa-4b5c-4859-8658-c31ac712ec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.611722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6baa-4b5c-4859-8658-c31ac712ec5c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.612010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6baa-4b5c-4859-8658-c31ac712ec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.612327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6baa-4b5c-4859-8658-c31ac712ec5c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.626082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a6baa-4b5c-4859-8658-c31ac712ec5c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:29.652320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a6baa-4b5c-4859-8658-c31ac712ec5c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.672280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-056a6baa-4b5c-4859-8658-c31ac712ec5c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 16 14:22:29.673416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 325/648] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:29.679967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a756734-88ee-4c62-9ee3-0237dd8ffb6b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.690093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a756734-88ee-4c62-9ee3-0237dd8ffb6b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.695610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4ae6b-83c3-4985-899c-b788d4f43726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.696207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4ae6b-83c3-4985-899c-b788d4f43726 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.696488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4ae6b-83c3-4985-899c-b788d4f43726 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.696762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4ae6b-83c3-4985-899c-b788d4f43726 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.697551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4ae6b-83c3-4985-899c-b788d4f43726 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:29.697846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4ae6b-83c3-4985-899c-b788d4f43726 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:29.723362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4ae6b-83c3-4985-899c-b788d4f43726 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.757132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 324/649] 10.222.0.67 () {56 vars in 1170 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:29.763083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a6baa-4b5c-4859-8658-c31ac712ec5c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.773164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a6baa-4b5c-4859-8658-c31ac712ec5c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.778518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829231-b9d3-4502-be72-af1a69ef285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.779076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829231-b9d3-4502-be72-af1a69ef285d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.779354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829231-b9d3-4502-be72-af1a69ef285d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.779666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829231-b9d3-4502-be72-af1a69ef285d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.788009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829231-b9d3-4502-be72-af1a69ef285d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:29.814024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829231-b9d3-4502-be72-af1a69ef285d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.822740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 326/650] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:29.828579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4ae6b-83c3-4985-899c-b788d4f43726 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.838014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4ae6b-83c3-4985-899c-b788d4f43726 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.842474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a654cc3-781c-4831-8829-9802768ff57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.843209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a654cc3-781c-4831-8829-9802768ff57c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.843494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a654cc3-781c-4831-8829-9802768ff57c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.843775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a654cc3-781c-4831-8829-9802768ff57c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.855461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a654cc3-781c-4831-8829-9802768ff57c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:29.881226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a654cc3-781c-4831-8829-9802768ff57c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.898750 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-8a654cc3-781c-4831-8829-9802768ff57c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:29.899892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 325/651] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:29.905917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829231-b9d3-4502-be72-af1a69ef285d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.915253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829231-b9d3-4502-be72-af1a69ef285d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.920656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e968c0a-51bf-4f99-937b-81c9f6921c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.921263 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e968c0a-51bf-4f99-937b-81c9f6921c10 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.921546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e968c0a-51bf-4f99-937b-81c9f6921c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.921824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e968c0a-51bf-4f99-937b-81c9f6921c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.922594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e968c0a-51bf-4f99-937b-81c9f6921c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:29.922892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e968c0a-51bf-4f99-937b-81c9f6921c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:29.949075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e968c0a-51bf-4f99-937b-81c9f6921c10 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:29.962828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 327/652] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:29.968454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a654cc3-781c-4831-8829-9802768ff57c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:29.978644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a654cc3-781c-4831-8829-9802768ff57c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:29.983914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6468b-9836-460c-bde6-48b8e5ec6d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:29.984636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6468b-9836-460c-bde6-48b8e5ec6d51 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:29.984916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6468b-9836-460c-bde6-48b8e5ec6d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:29.985194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6468b-9836-460c-bde6-48b8e5ec6d51 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:29.995303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6468b-9836-460c-bde6-48b8e5ec6d51 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:30.021232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6468b-9836-460c-bde6-48b8e5ec6d51 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:30.035810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-6db6468b-9836-460c-bde6-48b8e5ec6d51 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:30.036962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 326/653] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:30.043077 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e968c0a-51bf-4f99-937b-81c9f6921c10 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:30.053727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e968c0a-51bf-4f99-937b-81c9f6921c10 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:30.058868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56575d80-8d17-46f2-872f-092694b8f1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:30.059460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56575d80-8d17-46f2-872f-092694b8f1ab admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:30.059721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56575d80-8d17-46f2-872f-092694b8f1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:30.060019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56575d80-8d17-46f2-872f-092694b8f1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:30.060809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56575d80-8d17-46f2-872f-092694b8f1ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:30.061098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56575d80-8d17-46f2-872f-092694b8f1ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:30.087634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56575d80-8d17-46f2-872f-092694b8f1ab admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:30.102245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 328/654] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:30.108345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6468b-9836-460c-bde6-48b8e5ec6d51 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:30.118346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6468b-9836-460c-bde6-48b8e5ec6d51 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:30.122801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeea6eb-5874-4f48-be92-1ef9aaff465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:30.123374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeea6eb-5874-4f48-be92-1ef9aaff465e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:30.123664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeea6eb-5874-4f48-be92-1ef9aaff465e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:30.123934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeea6eb-5874-4f48-be92-1ef9aaff465e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:30.124714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeea6eb-5874-4f48-be92-1ef9aaff465e admin admin] RBAC: Adding query filter params (role.id=967b4cdf1e1f4431bd33c4e43e06506f, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=64742f0f7cf443f3ac3cc5505db446eb) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:30.125011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeea6eb-5874-4f48-be92-1ef9aaff465e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:30.151211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeea6eb-5874-4f48-be92-1ef9aaff465e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:30.157905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 327/655] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:30 2021] GET /identity/v3/role_assignments?user.id=64742f0f7cf443f3ac3cc5505db446eb&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=967b4cdf1e1f4431bd33c4e43e06506f => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:32.160606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04cbe-60b7-4a12-a849-38c33d877d82 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:32.161198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04cbe-60b7-4a12-a849-38c33d877d82 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:32.161198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04cbe-60b7-4a12-a849-38c33d877d82 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:32.162879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 329/656] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:32.170977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d164e-bb01-4b80-8194-4e0c252f05a0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:32.171420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d164e-bb01-4b80-8194-4e0c252f05a0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:32.171505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d164e-bb01-4b80-8194-4e0c252f05a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:32.196500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2d7d164e-bb01-4b80-8194-4e0c252f05a0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:32.197667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2d7d164e-bb01-4b80-8194-4e0c252f05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:32.205386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 328/657] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:32 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:32.228739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d04cbe-60b7-4a12-a849-38c33d877d82 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:32.242410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d04cbe-60b7-4a12-a849-38c33d877d82 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:32.247510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc22dc-2244-4b7a-88cb-eb09e287c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:32.248280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc22dc-2244-4b7a-88cb-eb09e287c609 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:32.248575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc22dc-2244-4b7a-88cb-eb09e287c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:32.248855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc22dc-2244-4b7a-88cb-eb09e287c609 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:32.249498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc22dc-2244-4b7a-88cb-eb09e287c609 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:32.275373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc22dc-2244-4b7a-88cb-eb09e287c609 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:32.287618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-d8fc22dc-2244-4b7a-88cb-eb09e287c609 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 16 14:22:32.288841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 330/658] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Dec 16 14:22:32 2021] GET /identity/v3/services/image => generated 86 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:32.295342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d164e-bb01-4b80-8194-4e0c252f05a0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:32.305120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d164e-bb01-4b80-8194-4e0c252f05a0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:32.309647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dd5e2-70ac-4746-a4fe-225ea1bcf823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:32.310297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd5e2-70ac-4746-a4fe-225ea1bcf823 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:32.310579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd5e2-70ac-4746-a4fe-225ea1bcf823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:32.310853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd5e2-70ac-4746-a4fe-225ea1bcf823 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:32.311578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dd5e2-70ac-4746-a4fe-225ea1bcf823 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:32.311876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dd5e2-70ac-4746-a4fe-225ea1bcf823 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:32.338029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dd5e2-70ac-4746-a4fe-225ea1bcf823 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:32.343556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 329/659] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:32 2021] GET /identity/v3/services?name=image => generated 122 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:32.350262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc22dc-2244-4b7a-88cb-eb09e287c609 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:32.360797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc22dc-2244-4b7a-88cb-eb09e287c609 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:32.366370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f069dc-689d-4b2e-9543-903d42e4067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:32.366975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f069dc-689d-4b2e-9543-903d42e4067e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:32.367238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f069dc-689d-4b2e-9543-903d42e4067e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:32.367503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f069dc-689d-4b2e-9543-903d42e4067e admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:32.368190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f069dc-689d-4b2e-9543-903d42e4067e admin admin] RBAC: Adding query filter params (type=image) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:32.368480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f069dc-689d-4b2e-9543-903d42e4067e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:32.398148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f069dc-689d-4b2e-9543-903d42e4067e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:32.403286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 331/660] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:32 2021] GET /identity/v3/services?type=image => generated 122 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:34.360251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba512d-e19b-4cee-ba60-13dd85d1d14d None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:34.360842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba512d-e19b-4cee-ba60-13dd85d1d14d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:34.360842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba512d-e19b-4cee-ba60-13dd85d1d14d None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:34.362705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 330/661] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:34.368157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc17a44-644c-4d0e-8277-82cd38ee3a1f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:34.368629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc17a44-644c-4d0e-8277-82cd38ee3a1f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:34.368716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc17a44-644c-4d0e-8277-82cd38ee3a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:34.391947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-abc17a44-644c-4d0e-8277-82cd38ee3a1f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:34.393018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-abc17a44-644c-4d0e-8277-82cd38ee3a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:34.401518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 332/662] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:34 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:34.423395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba512d-e19b-4cee-ba60-13dd85d1d14d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:34.438553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba512d-e19b-4cee-ba60-13dd85d1d14d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:34.443017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912197-bbb2-4242-b600-232ffe418503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:34.443611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912197-bbb2-4242-b600-232ffe418503 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:34.443889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912197-bbb2-4242-b600-232ffe418503 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:34.444168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912197-bbb2-4242-b600-232ffe418503 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:34.444846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912197-bbb2-4242-b600-232ffe418503 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:34.470569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912197-bbb2-4242-b600-232ffe418503 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:34.486528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 331/663] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:22:34 2021] POST /identity/v3/services => generated 242 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:22:36.489982 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df11ef-2230-4eb1-b957-9ec9ae66212e None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:36.490632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df11ef-2230-4eb1-b957-9ec9ae66212e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:36.490632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df11ef-2230-4eb1-b957-9ec9ae66212e None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.492163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 333/664] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:36.497681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb522-80b7-4d5c-ae87-eb32ed6c544f None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:36.498112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb522-80b7-4d5c-ae87-eb32ed6c544f None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:36.498276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb522-80b7-4d5c-ae87-eb32ed6c544f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.522572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-265cb522-80b7-4d5c-ae87-eb32ed6c544f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:36.523724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-265cb522-80b7-4d5c-ae87-eb32ed6c544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:36.543722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 332/665] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:36 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:36.566203 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df11ef-2230-4eb1-b957-9ec9ae66212e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:36.579716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df11ef-2230-4eb1-b957-9ec9ae66212e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:36.584478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212380-57f9-4759-9178-783313162ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:36.585189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212380-57f9-4759-9178-783313162ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:36.585470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212380-57f9-4759-9178-783313162ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:36.585742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212380-57f9-4759-9178-783313162ec1 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.586427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88212380-57f9-4759-9178-783313162ec1 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:36.611568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88212380-57f9-4759-9178-783313162ec1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:36.623198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-88212380-57f9-4759-9178-783313162ec1 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 16 14:22:36.624304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 334/666] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Dec 16 14:22:36 2021] GET /identity/v3/services/image => generated 86 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:36.630487 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cb522-80b7-4d5c-ae87-eb32ed6c544f None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:36.639661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cb522-80b7-4d5c-ae87-eb32ed6c544f None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:36.645495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055bd6d-9a1c-471c-9aec-904cd5ef9610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:36.646148 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055bd6d-9a1c-471c-9aec-904cd5ef9610 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:36.646432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055bd6d-9a1c-471c-9aec-904cd5ef9610 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:36.646707 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055bd6d-9a1c-471c-9aec-904cd5ef9610 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.647384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055bd6d-9a1c-471c-9aec-904cd5ef9610 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:36.647691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055bd6d-9a1c-471c-9aec-904cd5ef9610 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:36.677005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055bd6d-9a1c-471c-9aec-904cd5ef9610 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:36.682334 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 333/667] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:36 2021] GET /identity/v3/services?name=image => generated 122 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:36.688740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212380-57f9-4759-9178-783313162ec1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:36.699793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212380-57f9-4759-9178-783313162ec1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:36.705768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fa811-9ff3-4624-8bff-8e5db9a8dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:36.706391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fa811-9ff3-4624-8bff-8e5db9a8dbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:36.706754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fa811-9ff3-4624-8bff-8e5db9a8dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:36.707217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fa811-9ff3-4624-8bff-8e5db9a8dbf8 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.707684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fa811-9ff3-4624-8bff-8e5db9a8dbf8 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:36.707977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fa811-9ff3-4624-8bff-8e5db9a8dbf8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:36.733194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fa811-9ff3-4624-8bff-8e5db9a8dbf8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:36.738522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 335/668] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:36 2021] GET /identity/v3/services?type=image => generated 350 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:36.744757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055bd6d-9a1c-471c-9aec-904cd5ef9610 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:36.755026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055bd6d-9a1c-471c-9aec-904cd5ef9610 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:36.760562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e930a-4146-4fa8-aff0-aefcb6bd2564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:36.761185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e930a-4146-4fa8-aff0-aefcb6bd2564 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:36.761469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e930a-4146-4fa8-aff0-aefcb6bd2564 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:36.761748 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e930a-4146-4fa8-aff0-aefcb6bd2564 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.762540 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e930a-4146-4fa8-aff0-aefcb6bd2564 admin admin] RBAC: Adding query filter params (interface=public, service_id=555e44c7bc0b4e829ec107fcee1ce7ed, region_id=RegionOne) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:36.762845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e930a-4146-4fa8-aff0-aefcb6bd2564 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:36.788109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e930a-4146-4fa8-aff0-aefcb6bd2564 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:36.794327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 334/669] 10.222.0.67 () {56 vars in 1272 bytes} [Thu Dec 16 14:22:36 2021] GET /identity/v3/endpoints?service_id=555e44c7bc0b4e829ec107fcee1ce7ed&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:36.803006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fa811-9ff3-4624-8bff-8e5db9a8dbf8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:36.812906 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fa811-9ff3-4624-8bff-8e5db9a8dbf8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:36.818628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6ae67-bab6-4d57-bd2b-6bb6e3d9f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:36.819225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6ae67-bab6-4d57-bd2b-6bb6e3d9f281 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:36.819509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6ae67-bab6-4d57-bd2b-6bb6e3d9f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:36.819780 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6ae67-bab6-4d57-bd2b-6bb6e3d9f281 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:36.820434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6ae67-bab6-4d57-bd2b-6bb6e3d9f281 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:36.846396 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6ae67-bab6-4d57-bd2b-6bb6e3d9f281 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:36.856158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 336/670] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:22:36 2021] GET /identity/v3/services => generated 1022 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:22:38.830583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b98a-5341-4287-a494-0f4ffc22ad2a None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.831155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b98a-5341-4287-a494-0f4ffc22ad2a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.831155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b98a-5341-4287-a494-0f4ffc22ad2a None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.833332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 335/671] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:38.839935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832340-9340-4d40-8a3e-7816ac2279c8 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.840435 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832340-9340-4d40-8a3e-7816ac2279c8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.840525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832340-9340-4d40-8a3e-7816ac2279c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.865499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-01832340-9340-4d40-8a3e-7816ac2279c8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:38.866764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-01832340-9340-4d40-8a3e-7816ac2279c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:38.874162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 337/672] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:38 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:38.896908 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209b98a-5341-4287-a494-0f4ffc22ad2a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:38.910577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209b98a-5341-4287-a494-0f4ffc22ad2a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:38.915164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa376a-3e0d-4527-bf7c-7dea285a8b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:38.915875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa376a-3e0d-4527-bf7c-7dea285a8b82 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.916163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa376a-3e0d-4527-bf7c-7dea285a8b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.916446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa376a-3e0d-4527-bf7c-7dea285a8b82 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.917065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa376a-3e0d-4527-bf7c-7dea285a8b82 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:38.942873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa376a-3e0d-4527-bf7c-7dea285a8b82 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:38.954123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-8daa376a-3e0d-4527-bf7c-7dea285a8b82 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 16 14:22:38.955463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 336/673] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Dec 16 14:22:38 2021] GET /identity/v3/services/image => generated 86 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:38.961685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832340-9340-4d40-8a3e-7816ac2279c8 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:38.970844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01832340-9340-4d40-8a3e-7816ac2279c8 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:38.975986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd83123-a6dc-4da4-b1c7-24c39577d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:38.976574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd83123-a6dc-4da4-b1c7-24c39577d8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:38.976862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd83123-a6dc-4da4-b1c7-24c39577d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:38.977142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd83123-a6dc-4da4-b1c7-24c39577d8f9 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:38.977829 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd83123-a6dc-4da4-b1c7-24c39577d8f9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:38.978159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd83123-a6dc-4da4-b1c7-24c39577d8f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:39.003357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd83123-a6dc-4da4-b1c7-24c39577d8f9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:39.008252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 338/674] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:38 2021] GET /identity/v3/services?name=image => generated 122 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:39.014098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa376a-3e0d-4527-bf7c-7dea285a8b82 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:39.024203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa376a-3e0d-4527-bf7c-7dea285a8b82 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:39.028663 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f6ae2-bed2-4127-b36a-5ad803a3e278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:39.029259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f6ae2-bed2-4127-b36a-5ad803a3e278 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:39.029543 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f6ae2-bed2-4127-b36a-5ad803a3e278 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:39.029824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f6ae2-bed2-4127-b36a-5ad803a3e278 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:39.030538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f6ae2-bed2-4127-b36a-5ad803a3e278 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:39.030835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f6ae2-bed2-4127-b36a-5ad803a3e278 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:39.056784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f6ae2-bed2-4127-b36a-5ad803a3e278 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:39.061975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 337/675] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:39 2021] GET /identity/v3/services?type=image => generated 350 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:39.068516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd83123-a6dc-4da4-b1c7-24c39577d8f9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:39.078623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd83123-a6dc-4da4-b1c7-24c39577d8f9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:39.084044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ea04d-afac-4c82-ae4b-a43d03b6cb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:39.084560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea04d-afac-4c82-ae4b-a43d03b6cb42 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:39.084845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea04d-afac-4c82-ae4b-a43d03b6cb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:39.085116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea04d-afac-4c82-ae4b-a43d03b6cb42 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:39.085820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ea04d-afac-4c82-ae4b-a43d03b6cb42 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:39.111628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ea04d-afac-4c82-ae4b-a43d03b6cb42 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:39.136024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 339/676] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:22:39 2021] POST /identity/v3/endpoints => generated 327 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:22:41.121330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fc5ef-c1aa-4f8f-9df4-ae5cfd116393 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:41.121874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fc5ef-c1aa-4f8f-9df4-ae5cfd116393 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:41.121874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fc5ef-c1aa-4f8f-9df4-ae5cfd116393 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:41.123573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 338/677] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:41.128880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d220e-a422-48e5-ac23-3d7f00896b3c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:41.129508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d220e-a422-48e5-ac23-3d7f00896b3c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:41.129508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d220e-a422-48e5-ac23-3d7f00896b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:41.155569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-008d220e-a422-48e5-ac23-3d7f00896b3c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:41.156744 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-008d220e-a422-48e5-ac23-3d7f00896b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:41.176015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 340/678] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:41 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:41.198812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fc5ef-c1aa-4f8f-9df4-ae5cfd116393 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:41.214199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fc5ef-c1aa-4f8f-9df4-ae5cfd116393 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:41.219473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5a372-bce0-46a4-aae7-f9aed6d2ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:41.220058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a372-bce0-46a4-aae7-f9aed6d2ea6d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:41.220339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a372-bce0-46a4-aae7-f9aed6d2ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:41.220613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a372-bce0-46a4-aae7-f9aed6d2ea6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:41.228961 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5a372-bce0-46a4-aae7-f9aed6d2ea6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:41.254329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5a372-bce0-46a4-aae7-f9aed6d2ea6d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:41.265270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 339/679] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:41 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:41.271621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d220e-a422-48e5-ac23-3d7f00896b3c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:41.280926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d220e-a422-48e5-ac23-3d7f00896b3c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:41.285577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb81956-b5ec-403a-8344-2d5ce096f657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:41.286355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81956-b5ec-403a-8344-2d5ce096f657 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:41.286618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81956-b5ec-403a-8344-2d5ce096f657 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:41.286902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81956-b5ec-403a-8344-2d5ce096f657 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:41.288013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb81956-b5ec-403a-8344-2d5ce096f657 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:41.313802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb81956-b5ec-403a-8344-2d5ce096f657 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:41.315312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 341/680] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:43.401166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dea39-c728-496d-a09b-ddd4f2b31353 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.401746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dea39-c728-496d-a09b-ddd4f2b31353 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.401746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dea39-c728-496d-a09b-ddd4f2b31353 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.403375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 340/681] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:43.408604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f3c0f-2b00-4773-9191-f01a8a49a928 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.409080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f3c0f-2b00-4773-9191-f01a8a49a928 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.409179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f3c0f-2b00-4773-9191-f01a8a49a928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.433057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-478f3c0f-2b00-4773-9191-f01a8a49a928 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:43.434214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-478f3c0f-2b00-4773-9191-f01a8a49a928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:43.442750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 342/682] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:43 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:43.466314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dea39-c728-496d-a09b-ddd4f2b31353 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:43.480083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dea39-c728-496d-a09b-ddd4f2b31353 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:43.484933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c29ef-e2c9-4412-9d12-27aba02f4e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:43.485672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c29ef-e2c9-4412-9d12-27aba02f4e1a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.485963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c29ef-e2c9-4412-9d12-27aba02f4e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.486253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c29ef-e2c9-4412-9d12-27aba02f4e1a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.499076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c29ef-e2c9-4412-9d12-27aba02f4e1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:43.525011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c29ef-e2c9-4412-9d12-27aba02f4e1a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:43.542841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-344c29ef-e2c9-4412-9d12-27aba02f4e1a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:43.544014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 341/683] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:43.550746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f3c0f-2b00-4773-9191-f01a8a49a928 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:43.560356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f3c0f-2b00-4773-9191-f01a8a49a928 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:43.569300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9cc21-04d4-40ba-94f4-655e028ad82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:43.570261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9cc21-04d4-40ba-94f4-655e028ad82b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.570738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9cc21-04d4-40ba-94f4-655e028ad82b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.571198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9cc21-04d4-40ba-94f4-655e028ad82b admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.572323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9cc21-04d4-40ba-94f4-655e028ad82b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:43.572814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9cc21-04d4-40ba-94f4-655e028ad82b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:43.601812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9cc21-04d4-40ba-94f4-655e028ad82b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:43.614930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 343/684] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:43.620792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c29ef-e2c9-4412-9d12-27aba02f4e1a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:43.630715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c29ef-e2c9-4412-9d12-27aba02f4e1a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:43.635880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0049c-31bb-4849-9db6-bffe4b210388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:43.636485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0049c-31bb-4849-9db6-bffe4b210388 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:43.636769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0049c-31bb-4849-9db6-bffe4b210388 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:43.637048 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0049c-31bb-4849-9db6-bffe4b210388 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:43.637729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0049c-31bb-4849-9db6-bffe4b210388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:43.663810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0049c-31bb-4849-9db6-bffe4b210388 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:43.687935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 342/685] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:22:43 2021] POST /identity/v3/users => generated 248 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:22:45.688047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b01a7-74ab-4abd-86f9-4b5c06f44db5 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.688668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b01a7-74ab-4abd-86f9-4b5c06f44db5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.688668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b01a7-74ab-4abd-86f9-4b5c06f44db5 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.690317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 344/686] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:45.695922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9bbf-f79c-4aad-aa5a-5eb49dbdf919 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.696397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9bbf-f79c-4aad-aa5a-5eb49dbdf919 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.696494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa9bbf-f79c-4aad-aa5a-5eb49dbdf919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.719745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f8fa9bbf-f79c-4aad-aa5a-5eb49dbdf919 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:45.720881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f8fa9bbf-f79c-4aad-aa5a-5eb49dbdf919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:45.729582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 343/687] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:45 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:45.752254 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b01a7-74ab-4abd-86f9-4b5c06f44db5 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.766944 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b01a7-74ab-4abd-86f9-4b5c06f44db5 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.772039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc8973-3aac-4a63-a7c8-f7dd9ff63305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.772770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8973-3aac-4a63-a7c8-f7dd9ff63305 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.773057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8973-3aac-4a63-a7c8-f7dd9ff63305 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.773333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8973-3aac-4a63-a7c8-f7dd9ff63305 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.785503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc8973-3aac-4a63-a7c8-f7dd9ff63305 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:45.792139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-fedc8973-3aac-4a63-a7c8-f7dd9ff63305 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:22:45.793253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 345/688] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:45.799547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9bbf-f79c-4aad-aa5a-5eb49dbdf919 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.809083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa9bbf-f79c-4aad-aa5a-5eb49dbdf919 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.814411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e18d-c3ec-4646-b323-5a003b88be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.815008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e18d-c3ec-4646-b323-5a003b88be98 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.815287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e18d-c3ec-4646-b323-5a003b88be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.815562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e18d-c3ec-4646-b323-5a003b88be98 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.816279 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439e18d-c3ec-4646-b323-5a003b88be98 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:45.816603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439e18d-c3ec-4646-b323-5a003b88be98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:45.842458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439e18d-c3ec-4646-b323-5a003b88be98 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:45.851640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 344/689] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:45.857574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc8973-3aac-4a63-a7c8-f7dd9ff63305 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.868865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc8973-3aac-4a63-a7c8-f7dd9ff63305 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.874210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02317b8c-838d-4088-90a5-5fd6fda5131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.874935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02317b8c-838d-4088-90a5-5fd6fda5131e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.875223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02317b8c-838d-4088-90a5-5fd6fda5131e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.875499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02317b8c-838d-4088-90a5-5fd6fda5131e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.887737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02317b8c-838d-4088-90a5-5fd6fda5131e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:45.914028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02317b8c-838d-4088-90a5-5fd6fda5131e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:45.933087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-02317b8c-838d-4088-90a5-5fd6fda5131e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:45.934272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 346/690] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:45.940322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e18d-c3ec-4646-b323-5a003b88be98 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:45.950267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e18d-c3ec-4646-b323-5a003b88be98 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:45.955158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684afcf-2232-47e3-9d98-63c78d1a2b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:45.955742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684afcf-2232-47e3-9d98-63c78d1a2b2f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:45.956025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684afcf-2232-47e3-9d98-63c78d1a2b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:45.956296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684afcf-2232-47e3-9d98-63c78d1a2b2f admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:45.956983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684afcf-2232-47e3-9d98-63c78d1a2b2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:45.957424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684afcf-2232-47e3-9d98-63c78d1a2b2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:45.983257 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684afcf-2232-47e3-9d98-63c78d1a2b2f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:45.999826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 345/691] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:46.005975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02317b8c-838d-4088-90a5-5fd6fda5131e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:46.016546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02317b8c-838d-4088-90a5-5fd6fda5131e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:46.022334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a796-94c0-4e24-bd15-6f0ad6b7227e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:46.023064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a796-94c0-4e24-bd15-6f0ad6b7227e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:46.023346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a796-94c0-4e24-bd15-6f0ad6b7227e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:46.023619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a796-94c0-4e24-bd15-6f0ad6b7227e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:46.037421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568a796-94c0-4e24-bd15-6f0ad6b7227e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:46.063392 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568a796-94c0-4e24-bd15-6f0ad6b7227e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:46.082158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-5568a796-94c0-4e24-bd15-6f0ad6b7227e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 16 14:22:46.083431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 347/692] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:46 2021] GET /identity/v3/users/cinder => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:46.089583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684afcf-2232-47e3-9d98-63c78d1a2b2f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:46.099957 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684afcf-2232-47e3-9d98-63c78d1a2b2f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:46.105004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea434fc-beb9-489f-9253-459f46fedd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:46.105621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea434fc-beb9-489f-9253-459f46fedd27 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:46.105914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea434fc-beb9-489f-9253-459f46fedd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:46.106230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea434fc-beb9-489f-9253-459f46fedd27 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:46.107045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea434fc-beb9-489f-9253-459f46fedd27 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:46.107346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea434fc-beb9-489f-9253-459f46fedd27 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:46.133300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea434fc-beb9-489f-9253-459f46fedd27 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:46.166867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 346/693] 10.222.0.67 () {56 vars in 1158 bytes} [Thu Dec 16 14:22:46 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:46.173868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a796-94c0-4e24-bd15-6f0ad6b7227e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:46.190035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a796-94c0-4e24-bd15-6f0ad6b7227e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:46.196075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d0be1-d171-4ed4-b8df-6f0f319b425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:46.196592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d0be1-d171-4ed4-b8df-6f0f319b425f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:46.196876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d0be1-d171-4ed4-b8df-6f0f319b425f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:46.197147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d0be1-d171-4ed4-b8df-6f0f319b425f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:46.205292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d0be1-d171-4ed4-b8df-6f0f319b425f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:46.231585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d0be1-d171-4ed4-b8df-6f0f319b425f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:46.241263 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 348/694] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:46 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:46.247233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea434fc-beb9-489f-9253-459f46fedd27 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:46.258377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea434fc-beb9-489f-9253-459f46fedd27 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:46.263229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a6730-aab3-4c98-a199-7425673809e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:46.264034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6730-aab3-4c98-a199-7425673809e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:46.264313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6730-aab3-4c98-a199-7425673809e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:46.264625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6730-aab3-4c98-a199-7425673809e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:46.278517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a6730-aab3-4c98-a199-7425673809e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:46.305676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a6730-aab3-4c98-a199-7425673809e8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:46.324146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-a08a6730-aab3-4c98-a199-7425673809e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:46.325302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 347/695] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:46.331305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d0be1-d171-4ed4-b8df-6f0f319b425f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:46.343574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d0be1-d171-4ed4-b8df-6f0f319b425f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:46.350356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b682f-70cb-4d23-a784-ffd4be6964b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:46.351007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b682f-70cb-4d23-a784-ffd4be6964b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:46.351285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b682f-70cb-4d23-a784-ffd4be6964b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:46.351561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b682f-70cb-4d23-a784-ffd4be6964b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:46.352300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b682f-70cb-4d23-a784-ffd4be6964b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:46.352594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b682f-70cb-4d23-a784-ffd4be6964b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:46.378234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b682f-70cb-4d23-a784-ffd4be6964b2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:46.393167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 349/696] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:46.399564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a6730-aab3-4c98-a199-7425673809e8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:46.409553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a6730-aab3-4c98-a199-7425673809e8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:46.414241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380419-1e51-481a-abd2-81b5ad28863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:46.414986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380419-1e51-481a-abd2-81b5ad28863f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:46.415270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380419-1e51-481a-abd2-81b5ad28863f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:46.415547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380419-1e51-481a-abd2-81b5ad28863f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:46.426041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e380419-1e51-481a-abd2-81b5ad28863f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:46.453017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e380419-1e51-481a-abd2-81b5ad28863f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:46.468579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-7e380419-1e51-481a-abd2-81b5ad28863f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:46.469798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 348/697] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:46.476352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b682f-70cb-4d23-a784-ffd4be6964b2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:46.486863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b682f-70cb-4d23-a784-ffd4be6964b2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:46.492980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352632f6-5c02-4ed3-9532-57400a9e90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:46.493592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352632f6-5c02-4ed3-9532-57400a9e90c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:46.493872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352632f6-5c02-4ed3-9532-57400a9e90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:46.494179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352632f6-5c02-4ed3-9532-57400a9e90c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:46.494971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352632f6-5c02-4ed3-9532-57400a9e90c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:46.495266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352632f6-5c02-4ed3-9532-57400a9e90c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:46.522610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352632f6-5c02-4ed3-9532-57400a9e90c4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:46.538521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 350/698] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:46.546219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380419-1e51-481a-abd2-81b5ad28863f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:46.557283 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380419-1e51-481a-abd2-81b5ad28863f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:46.562697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc46905-5125-4b56-9166-7ae37aa5451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:46.563286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46905-5125-4b56-9166-7ae37aa5451e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:46.563565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46905-5125-4b56-9166-7ae37aa5451e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:46.563834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46905-5125-4b56-9166-7ae37aa5451e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:46.564623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc46905-5125-4b56-9166-7ae37aa5451e admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=bb089e686c2540bfadf60b8ea010e441) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:46.564930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc46905-5125-4b56-9166-7ae37aa5451e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:46.590495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc46905-5125-4b56-9166-7ae37aa5451e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:46.596880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 349/699] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:46 2021] GET /identity/v3/role_assignments?user.id=bb089e686c2540bfadf60b8ea010e441&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:48.544189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29847823-78e5-4ac9-ac9e-0b70e50000a1 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:48.544753 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29847823-78e5-4ac9-ac9e-0b70e50000a1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:48.544753 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29847823-78e5-4ac9-ac9e-0b70e50000a1 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:48.546413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 351/700] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:48.552972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0804d7-a4be-480b-8cc7-648c566548f4 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:48.553556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0804d7-a4be-480b-8cc7-648c566548f4 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:48.553556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0804d7-a4be-480b-8cc7-648c566548f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:48.578964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-eb0804d7-a4be-480b-8cc7-648c566548f4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:48.580149 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-eb0804d7-a4be-480b-8cc7-648c566548f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:48.588681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 350/701] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:48 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:48.610951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29847823-78e5-4ac9-ac9e-0b70e50000a1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:48.625573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29847823-78e5-4ac9-ac9e-0b70e50000a1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:48.630879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbf40c-cc67-417b-8ea6-36b8538392ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:48.631612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbf40c-cc67-417b-8ea6-36b8538392ee admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:48.631903 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbf40c-cc67-417b-8ea6-36b8538392ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:48.632182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbf40c-cc67-417b-8ea6-36b8538392ee admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:48.646531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbf40c-cc67-417b-8ea6-36b8538392ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:48.653186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-dedbf40c-cc67-417b-8ea6-36b8538392ee admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:22:48.654360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 352/702] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:22:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:48.663237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0804d7-a4be-480b-8cc7-648c566548f4 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:48.673480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0804d7-a4be-480b-8cc7-648c566548f4 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:48.679008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b29a4-3c3c-4739-a317-492d61554664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:48.679614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b29a4-3c3c-4739-a317-492d61554664 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:48.679898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b29a4-3c3c-4739-a317-492d61554664 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:48.680177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b29a4-3c3c-4739-a317-492d61554664 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:48.680897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b29a4-3c3c-4739-a317-492d61554664 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:48.681203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b29a4-3c3c-4739-a317-492d61554664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:48.706548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b29a4-3c3c-4739-a317-492d61554664 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:48.716405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 351/703] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:22:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:48.722636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbf40c-cc67-417b-8ea6-36b8538392ee admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:48.734686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbf40c-cc67-417b-8ea6-36b8538392ee admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:48.741690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f154367-d79b-4e84-800d-6ffbc24c37da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:48.742477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f154367-d79b-4e84-800d-6ffbc24c37da admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:48.742756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f154367-d79b-4e84-800d-6ffbc24c37da admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:48.743031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f154367-d79b-4e84-800d-6ffbc24c37da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:48.755649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f154367-d79b-4e84-800d-6ffbc24c37da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:48.781638 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f154367-d79b-4e84-800d-6ffbc24c37da admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:48.800800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-1f154367-d79b-4e84-800d-6ffbc24c37da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:48.802387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 353/704] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:48.808468 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b29a4-3c3c-4739-a317-492d61554664 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:48.818413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b29a4-3c3c-4739-a317-492d61554664 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:48.823699 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f0161-69e6-48ed-b3de-23f45798b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:48.824284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f0161-69e6-48ed-b3de-23f45798b536 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:48.824562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f0161-69e6-48ed-b3de-23f45798b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:48.824837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f0161-69e6-48ed-b3de-23f45798b536 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:48.825514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f0161-69e6-48ed-b3de-23f45798b536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:48.825806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f0161-69e6-48ed-b3de-23f45798b536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:48.861739 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f0161-69e6-48ed-b3de-23f45798b536 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:48.875900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 352/705] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:48.882028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f154367-d79b-4e84-800d-6ffbc24c37da admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:48.891668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f154367-d79b-4e84-800d-6ffbc24c37da admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:48.896796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c129edc-fb6d-46e0-b0a7-b5d8469a8746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:48.897524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c129edc-fb6d-46e0-b0a7-b5d8469a8746 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:48.897804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c129edc-fb6d-46e0-b0a7-b5d8469a8746 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:48.898110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c129edc-fb6d-46e0-b0a7-b5d8469a8746 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:48.911656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c129edc-fb6d-46e0-b0a7-b5d8469a8746 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:48.937782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c129edc-fb6d-46e0-b0a7-b5d8469a8746 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:48.956713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-2c129edc-fb6d-46e0-b0a7-b5d8469a8746 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 16 14:22:48.958027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 354/706] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:48 2021] GET /identity/v3/users/cinder => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:48.964076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f0161-69e6-48ed-b3de-23f45798b536 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:48.974227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f0161-69e6-48ed-b3de-23f45798b536 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:48.979607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c3251-6d19-4eb3-b5f5-a748f48cbce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:48.980200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c3251-6d19-4eb3-b5f5-a748f48cbce9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:48.980486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c3251-6d19-4eb3-b5f5-a748f48cbce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:48.980764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c3251-6d19-4eb3-b5f5-a748f48cbce9 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:48.981554 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c3251-6d19-4eb3-b5f5-a748f48cbce9 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:48.981851 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c3251-6d19-4eb3-b5f5-a748f48cbce9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:49.007615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c3251-6d19-4eb3-b5f5-a748f48cbce9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:49.037119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 353/707] 10.222.0.67 () {56 vars in 1158 bytes} [Thu Dec 16 14:22:48 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:49.042907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c129edc-fb6d-46e0-b0a7-b5d8469a8746 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:49.053363 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c129edc-fb6d-46e0-b0a7-b5d8469a8746 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:49.058171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f2ab-eef3-4c9c-ab14-8f3eab7fb31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:49.058892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f2ab-eef3-4c9c-ab14-8f3eab7fb31e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:49.059177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f2ab-eef3-4c9c-ab14-8f3eab7fb31e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:49.059454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f2ab-eef3-4c9c-ab14-8f3eab7fb31e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:49.073670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05f2ab-eef3-4c9c-ab14-8f3eab7fb31e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:49.099291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05f2ab-eef3-4c9c-ab14-8f3eab7fb31e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:49.117608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-be05f2ab-eef3-4c9c-ab14-8f3eab7fb31e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:49.118809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 355/708] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:49.124603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c3251-6d19-4eb3-b5f5-a748f48cbce9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:49.134405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c3251-6d19-4eb3-b5f5-a748f48cbce9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:49.138924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deb0d5-b8b0-4684-b208-469bdf6cdd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:49.139533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deb0d5-b8b0-4684-b208-469bdf6cdd2f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:49.139820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deb0d5-b8b0-4684-b208-469bdf6cdd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:49.140099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deb0d5-b8b0-4684-b208-469bdf6cdd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:49.140792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deb0d5-b8b0-4684-b208-469bdf6cdd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:49.141091 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deb0d5-b8b0-4684-b208-469bdf6cdd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:49.167006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deb0d5-b8b0-4684-b208-469bdf6cdd2f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:49.180346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 354/709] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:49.186228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f2ab-eef3-4c9c-ab14-8f3eab7fb31e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:49.196523 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f2ab-eef3-4c9c-ab14-8f3eab7fb31e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:49.201759 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce89b8a-a184-4007-bc35-d9a6e63fc140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:49.202563 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce89b8a-a184-4007-bc35-d9a6e63fc140 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:49.202845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce89b8a-a184-4007-bc35-d9a6e63fc140 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:49.203118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce89b8a-a184-4007-bc35-d9a6e63fc140 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:49.213559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce89b8a-a184-4007-bc35-d9a6e63fc140 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:49.239615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce89b8a-a184-4007-bc35-d9a6e63fc140 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:49.254974 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-bce89b8a-a184-4007-bc35-d9a6e63fc140 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:49.256342 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 356/710] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:49.262590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deb0d5-b8b0-4684-b208-469bdf6cdd2f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:49.273071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deb0d5-b8b0-4684-b208-469bdf6cdd2f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:49.277690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73d59-05f5-45c7-bb74-f39dbe7c125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:49.278325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73d59-05f5-45c7-bb74-f39dbe7c125e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:49.278612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73d59-05f5-45c7-bb74-f39dbe7c125e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:49.278894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73d59-05f5-45c7-bb74-f39dbe7c125e admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:49.279667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced73d59-05f5-45c7-bb74-f39dbe7c125e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:49.279985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced73d59-05f5-45c7-bb74-f39dbe7c125e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:49.306039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced73d59-05f5-45c7-bb74-f39dbe7c125e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:49.319989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 355/711] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:49.327108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce89b8a-a184-4007-bc35-d9a6e63fc140 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:49.337212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce89b8a-a184-4007-bc35-d9a6e63fc140 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:49.341705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca4f26-ac72-47ea-9d00-32a53982daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:49.342665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca4f26-ac72-47ea-9d00-32a53982daef admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:49.342945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca4f26-ac72-47ea-9d00-32a53982daef admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:49.343218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca4f26-ac72-47ea-9d00-32a53982daef admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/bb089e686c2540bfadf60b8ea010e441/roles/26d42daa051b453488fbaac4330bd6ab` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:49.364166 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca4f26-ac72-47ea-9d00-32a53982daef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=bb089e686c2540bfadf60b8ea010e441, role_id=26d42daa051b453488fbaac4330bd6ab)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:49.390639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca4f26-ac72-47ea-9d00-32a53982daef admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:49.404717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 357/712] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:22:49 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/bb089e686c2540bfadf60b8ea010e441/roles/26d42daa051b453488fbaac4330bd6ab => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:22:51.349544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de07cb-e995-4ebb-82dc-5b45ba5189c7 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.350173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de07cb-e995-4ebb-82dc-5b45ba5189c7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.350173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de07cb-e995-4ebb-82dc-5b45ba5189c7 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.351789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 356/713] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:51.357195 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31045a44-5de4-4390-a8d7-1a3742d45c74 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.357638 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31045a44-5de4-4390-a8d7-1a3742d45c74 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.357723 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31045a44-5de4-4390-a8d7-1a3742d45c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.381679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-31045a44-5de4-4390-a8d7-1a3742d45c74 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:51.382872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-31045a44-5de4-4390-a8d7-1a3742d45c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:51.451345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 358/714] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:51 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:51.474913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de07cb-e995-4ebb-82dc-5b45ba5189c7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:51.488056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de07cb-e995-4ebb-82dc-5b45ba5189c7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:51.493208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1ba1f-78aa-4468-acaa-4c164652ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:51.493941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1ba1f-78aa-4468-acaa-4c164652ccde admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.494254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1ba1f-78aa-4468-acaa-4c164652ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.494531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1ba1f-78aa-4468-acaa-4c164652ccde admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.506625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1ba1f-78aa-4468-acaa-4c164652ccde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:22:51.513153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-5cc1ba1f-78aa-4468-acaa-4c164652ccde admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:22:51.514313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 357/715] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:22:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:51.520393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31045a44-5de4-4390-a8d7-1a3742d45c74 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:51.529364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31045a44-5de4-4390-a8d7-1a3742d45c74 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:51.533869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236979d9-d1e4-4748-a4b6-e6413b3f3f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:51.534495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236979d9-d1e4-4748-a4b6-e6413b3f3f33 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.534756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236979d9-d1e4-4748-a4b6-e6413b3f3f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.535060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236979d9-d1e4-4748-a4b6-e6413b3f3f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.535771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236979d9-d1e4-4748-a4b6-e6413b3f3f33 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:51.536183 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236979d9-d1e4-4748-a4b6-e6413b3f3f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:51.562290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236979d9-d1e4-4748-a4b6-e6413b3f3f33 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:51.571587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 359/716] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:22:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:51.577479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1ba1f-78aa-4468-acaa-4c164652ccde admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:51.588506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1ba1f-78aa-4468-acaa-4c164652ccde admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:51.593898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626530f6-dba6-41bd-9fe0-a86086100f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:51.594697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626530f6-dba6-41bd-9fe0-a86086100f52 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.594977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626530f6-dba6-41bd-9fe0-a86086100f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.595252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626530f6-dba6-41bd-9fe0-a86086100f52 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.608298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626530f6-dba6-41bd-9fe0-a86086100f52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:51.634777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626530f6-dba6-41bd-9fe0-a86086100f52 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:51.655410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-626530f6-dba6-41bd-9fe0-a86086100f52 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:51.656590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 358/717] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:51.662769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236979d9-d1e4-4748-a4b6-e6413b3f3f33 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:51.672718 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236979d9-d1e4-4748-a4b6-e6413b3f3f33 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:51.678526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb2d3-68ce-4d99-b5e7-0209f8bd7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:51.679121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb2d3-68ce-4d99-b5e7-0209f8bd7b84 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.679399 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb2d3-68ce-4d99-b5e7-0209f8bd7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.679669 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb2d3-68ce-4d99-b5e7-0209f8bd7b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.680355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bb2d3-68ce-4d99-b5e7-0209f8bd7b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:51.680646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bb2d3-68ce-4d99-b5e7-0209f8bd7b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:51.706041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bb2d3-68ce-4d99-b5e7-0209f8bd7b84 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:51.720039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 360/718] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:51.725921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626530f6-dba6-41bd-9fe0-a86086100f52 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:51.736061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626530f6-dba6-41bd-9fe0-a86086100f52 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:51.741980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f7bb6-26b1-4fab-b306-e5c3d75aa58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:51.742765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7bb6-26b1-4fab-b306-e5c3d75aa58a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.742997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7bb6-26b1-4fab-b306-e5c3d75aa58a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.743309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7bb6-26b1-4fab-b306-e5c3d75aa58a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.758114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f7bb6-26b1-4fab-b306-e5c3d75aa58a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:51.784357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f7bb6-26b1-4fab-b306-e5c3d75aa58a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:51.804642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-5b1f7bb6-26b1-4fab-b306-e5c3d75aa58a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 16 14:22:51.805786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 359/719] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:22:51 2021] GET /identity/v3/users/cinder => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:51.811752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb2d3-68ce-4d99-b5e7-0209f8bd7b84 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:51.821909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb2d3-68ce-4d99-b5e7-0209f8bd7b84 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:51.826437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c39461-4ba2-4468-85c5-2d967006ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:51.827028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c39461-4ba2-4468-85c5-2d967006ac44 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.827310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c39461-4ba2-4468-85c5-2d967006ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.827582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c39461-4ba2-4468-85c5-2d967006ac44 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.828375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c39461-4ba2-4468-85c5-2d967006ac44 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:51.828671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c39461-4ba2-4468-85c5-2d967006ac44 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:51.855336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c39461-4ba2-4468-85c5-2d967006ac44 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:51.885958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 361/720] 10.222.0.67 () {56 vars in 1158 bytes} [Thu Dec 16 14:22:51 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:51.891800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f7bb6-26b1-4fab-b306-e5c3d75aa58a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:51.901871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f7bb6-26b1-4fab-b306-e5c3d75aa58a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:51.906912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3db7a9-4548-447a-8773-a3d80394bb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:51.907489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3db7a9-4548-447a-8773-a3d80394bb2a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.907774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3db7a9-4548-447a-8773-a3d80394bb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.908051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3db7a9-4548-447a-8773-a3d80394bb2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.917047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3db7a9-4548-447a-8773-a3d80394bb2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:51.943787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3db7a9-4548-447a-8773-a3d80394bb2a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:51.953457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 360/721] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:22:51 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:22:51.960365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c39461-4ba2-4468-85c5-2d967006ac44 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:51.970251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c39461-4ba2-4468-85c5-2d967006ac44 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:51.976314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab337875-eb5b-4d9f-ae6e-9dee52cf1c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:51.977051 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab337875-eb5b-4d9f-ae6e-9dee52cf1c01 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:51.977333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab337875-eb5b-4d9f-ae6e-9dee52cf1c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:51.977605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab337875-eb5b-4d9f-ae6e-9dee52cf1c01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:51.990530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab337875-eb5b-4d9f-ae6e-9dee52cf1c01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:52.016716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab337875-eb5b-4d9f-ae6e-9dee52cf1c01 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.034487 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-ab337875-eb5b-4d9f-ae6e-9dee52cf1c01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:22:52.035611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 362/722] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:22:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:52.042015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3db7a9-4548-447a-8773-a3d80394bb2a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.051398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3db7a9-4548-447a-8773-a3d80394bb2a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.056848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae609b2d-ebb7-4815-975a-765a227d0cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.057444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae609b2d-ebb7-4815-975a-765a227d0cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.057726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae609b2d-ebb7-4815-975a-765a227d0cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.058025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae609b2d-ebb7-4815-975a-765a227d0cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.058730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae609b2d-ebb7-4815-975a-765a227d0cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:52.059028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae609b2d-ebb7-4815-975a-765a227d0cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:52.084488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae609b2d-ebb7-4815-975a-765a227d0cc1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.099862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 361/723] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:52.105653 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab337875-eb5b-4d9f-ae6e-9dee52cf1c01 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.116100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab337875-eb5b-4d9f-ae6e-9dee52cf1c01 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.121275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25fafd-7535-400a-8e66-7eb96517bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.122020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25fafd-7535-400a-8e66-7eb96517bf9d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.122325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25fafd-7535-400a-8e66-7eb96517bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.122600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25fafd-7535-400a-8e66-7eb96517bf9d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.132771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25fafd-7535-400a-8e66-7eb96517bf9d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:52.158534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25fafd-7535-400a-8e66-7eb96517bf9d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.173555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-da25fafd-7535-400a-8e66-7eb96517bf9d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:22:52.174726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 363/724] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:52.181216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae609b2d-ebb7-4815-975a-765a227d0cc1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.191165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae609b2d-ebb7-4815-975a-765a227d0cc1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.195814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a5f93-40dd-418d-8b0e-2a87f7c72f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.196405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a5f93-40dd-418d-8b0e-2a87f7c72f0f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.196687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a5f93-40dd-418d-8b0e-2a87f7c72f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.196964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a5f93-40dd-418d-8b0e-2a87f7c72f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.197705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a5f93-40dd-418d-8b0e-2a87f7c72f0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:52.198017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a5f93-40dd-418d-8b0e-2a87f7c72f0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:52.223871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a5f93-40dd-418d-8b0e-2a87f7c72f0f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.237667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 362/725] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:52.243990 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25fafd-7535-400a-8e66-7eb96517bf9d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:52.254115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25fafd-7535-400a-8e66-7eb96517bf9d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:52.259770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c058c80-1df5-4800-8e3e-4e1e1370c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:52.260360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058c80-1df5-4800-8e3e-4e1e1370c189 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:52.260643 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058c80-1df5-4800-8e3e-4e1e1370c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:52.260915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c058c80-1df5-4800-8e3e-4e1e1370c189 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:52.261711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058c80-1df5-4800-8e3e-4e1e1370c189 admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=bb089e686c2540bfadf60b8ea010e441) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:52.262021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058c80-1df5-4800-8e3e-4e1e1370c189 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:52.287875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c058c80-1df5-4800-8e3e-4e1e1370c189 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:52.294554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 364/726] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:22:52 2021] GET /identity/v3/role_assignments?user.id=bb089e686c2540bfadf60b8ea010e441&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:54.310748 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abeb0f-0704-49e8-bce7-8b08662816df None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:54.311329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abeb0f-0704-49e8-bce7-8b08662816df None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:54.311329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abeb0f-0704-49e8-bce7-8b08662816df None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:54.313115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 363/727] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:54.319572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfee81-06f8-4279-b78f-5c0951cc7f00 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:54.320192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfee81-06f8-4279-b78f-5c0951cc7f00 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:54.320192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfee81-06f8-4279-b78f-5c0951cc7f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:54.344777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-4adfee81-06f8-4279-b78f-5c0951cc7f00 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:54.345948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4adfee81-06f8-4279-b78f-5c0951cc7f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:54.354609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 365/728] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:54 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:54.377363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abeb0f-0704-49e8-bce7-8b08662816df None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:54.391203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abeb0f-0704-49e8-bce7-8b08662816df None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:54.396039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01346a-ad12-4cbf-b493-d4a0d4a3db59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:54.396824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01346a-ad12-4cbf-b493-d4a0d4a3db59 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:54.397117 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01346a-ad12-4cbf-b493-d4a0d4a3db59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:54.397404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01346a-ad12-4cbf-b493-d4a0d4a3db59 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:54.398022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01346a-ad12-4cbf-b493-d4a0d4a3db59 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:54.423414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01346a-ad12-4cbf-b493-d4a0d4a3db59 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:54.435580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-db01346a-ad12-4cbf-b493-d4a0d4a3db59 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 16 14:22:54.436683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 364/729] 10.222.0.67 () {56 vars in 1150 bytes} [Thu Dec 16 14:22:54 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:54.442883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfee81-06f8-4279-b78f-5c0951cc7f00 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:54.452091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfee81-06f8-4279-b78f-5c0951cc7f00 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:54.457507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571edb7-e129-466c-9663-0b96662e10bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:54.458152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571edb7-e129-466c-9663-0b96662e10bf admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:54.458439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571edb7-e129-466c-9663-0b96662e10bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:54.458711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571edb7-e129-466c-9663-0b96662e10bf admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:54.459394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571edb7-e129-466c-9663-0b96662e10bf admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:54.459692 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571edb7-e129-466c-9663-0b96662e10bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:54.485090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571edb7-e129-466c-9663-0b96662e10bf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:54.490290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 366/730] 10.222.0.67 () {56 vars in 1145 bytes} [Thu Dec 16 14:22:54 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:54.496433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01346a-ad12-4cbf-b493-d4a0d4a3db59 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:54.506676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01346a-ad12-4cbf-b493-d4a0d4a3db59 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:54.512041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ed9d-cf37-4122-92b4-f5c9eecf0ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:54.512648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ed9d-cf37-4122-92b4-f5c9eecf0ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:54.512933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ed9d-cf37-4122-92b4-f5c9eecf0ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:54.513211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ed9d-cf37-4122-92b4-f5c9eecf0ab7 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:54.513905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ed9d-cf37-4122-92b4-f5c9eecf0ab7 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:54.514231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ed9d-cf37-4122-92b4-f5c9eecf0ab7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:54.539622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ed9d-cf37-4122-92b4-f5c9eecf0ab7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:54.544287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 365/731] 10.222.0.67 () {56 vars in 1145 bytes} [Thu Dec 16 14:22:54 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:56.521095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519ef79-d05b-4168-aca2-b965a3740856 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:56.521678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519ef79-d05b-4168-aca2-b965a3740856 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:56.521678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519ef79-d05b-4168-aca2-b965a3740856 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:56.523251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 367/732] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:56.529031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c0d8b-82a3-4e1c-b80a-edd5a0ff23b2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:56.529502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c0d8b-82a3-4e1c-b80a-edd5a0ff23b2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:56.529602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c0d8b-82a3-4e1c-b80a-edd5a0ff23b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:56.553980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4d1c0d8b-82a3-4e1c-b80a-edd5a0ff23b2 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:56.555183 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4d1c0d8b-82a3-4e1c-b80a-edd5a0ff23b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:56.563569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 366/733] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:56 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:56.586448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519ef79-d05b-4168-aca2-b965a3740856 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:56.599997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519ef79-d05b-4168-aca2-b965a3740856 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:56.604631 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d370cc8-b0b0-4562-8358-20b39907fb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:56.605214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d370cc8-b0b0-4562-8358-20b39907fb55 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:56.605494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d370cc8-b0b0-4562-8358-20b39907fb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:56.605769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d370cc8-b0b0-4562-8358-20b39907fb55 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:56.606487 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d370cc8-b0b0-4562-8358-20b39907fb55 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:56.632058 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d370cc8-b0b0-4562-8358-20b39907fb55 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:56.647963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 368/734] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:22:56 2021] POST /identity/v3/services => generated 251 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:22:58.639614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a6230-5408-4953-b18c-e7e596326e71 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:58.640185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a6230-5408-4953-b18c-e7e596326e71 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:58.640185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a6230-5408-4953-b18c-e7e596326e71 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:58.641844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 367/735] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:22:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:22:58.647259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef8e9f-8e64-47c6-8a8a-81a43a1c8121 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:58.647722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef8e9f-8e64-47c6-8a8a-81a43a1c8121 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:58.647812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef8e9f-8e64-47c6-8a8a-81a43a1c8121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:58.672288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-f6ef8e9f-8e64-47c6-8a8a-81a43a1c8121 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:22:58.673412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f6ef8e9f-8e64-47c6-8a8a-81a43a1c8121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:22:58.692418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 369/736] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:22:58 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:22:58.714782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a6230-5408-4953-b18c-e7e596326e71 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:58.728857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a6230-5408-4953-b18c-e7e596326e71 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:58.733846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af11e1-1915-41db-a459-323deac04ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:58.734652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af11e1-1915-41db-a459-323deac04ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:58.734934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af11e1-1915-41db-a459-323deac04ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:58.735208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af11e1-1915-41db-a459-323deac04ac2 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:58.735857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af11e1-1915-41db-a459-323deac04ac2 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:58.762265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af11e1-1915-41db-a459-323deac04ac2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:58.775552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-11af11e1-1915-41db-a459-323deac04ac2 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 16 14:22:58.776674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 368/737] 10.222.0.67 () {56 vars in 1150 bytes} [Thu Dec 16 14:22:58 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:22:58.783115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef8e9f-8e64-47c6-8a8a-81a43a1c8121 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:58.792328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef8e9f-8e64-47c6-8a8a-81a43a1c8121 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:58.797863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeff40-cf39-43e8-80ac-7caebd03fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:58.798496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeff40-cf39-43e8-80ac-7caebd03fae2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:58.798781 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeff40-cf39-43e8-80ac-7caebd03fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:58.799058 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeff40-cf39-43e8-80ac-7caebd03fae2 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:58.799743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeff40-cf39-43e8-80ac-7caebd03fae2 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:58.800046 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeff40-cf39-43e8-80ac-7caebd03fae2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:58.828793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeff40-cf39-43e8-80ac-7caebd03fae2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:58.834385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 370/738] 10.222.0.67 () {56 vars in 1145 bytes} [Thu Dec 16 14:22:58 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:58.840519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af11e1-1915-41db-a459-323deac04ac2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:58.850729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af11e1-1915-41db-a459-323deac04ac2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:58.855040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846923fb-7867-4894-89ed-2afd56f7a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:58.855637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846923fb-7867-4894-89ed-2afd56f7a9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:58.855921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846923fb-7867-4894-89ed-2afd56f7a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:58.856196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846923fb-7867-4894-89ed-2afd56f7a9f9 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:58.856885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846923fb-7867-4894-89ed-2afd56f7a9f9 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:58.857180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846923fb-7867-4894-89ed-2afd56f7a9f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:58.882918 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846923fb-7867-4894-89ed-2afd56f7a9f9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:58.888475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 369/739] 10.222.0.67 () {56 vars in 1145 bytes} [Thu Dec 16 14:22:58 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:58.894850 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeff40-cf39-43e8-80ac-7caebd03fae2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:58.905298 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeff40-cf39-43e8-80ac-7caebd03fae2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:58.910502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a424e1-7e57-4b61-9f8f-2fa30de0ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:58.911109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a424e1-7e57-4b61-9f8f-2fa30de0ab86 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:58.911413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a424e1-7e57-4b61-9f8f-2fa30de0ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:58.912230 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a424e1-7e57-4b61-9f8f-2fa30de0ab86 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:58.913008 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a424e1-7e57-4b61-9f8f-2fa30de0ab86 admin admin] RBAC: Adding query filter params (interface=public, service_id=3c3433d1bbb44c37bce95515256e1315, region_id=RegionOne) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:22:58.913312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a424e1-7e57-4b61-9f8f-2fa30de0ab86 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:58.942052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a424e1-7e57-4b61-9f8f-2fa30de0ab86 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:58.949796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 371/740] 10.222.0.67 () {56 vars in 1272 bytes} [Thu Dec 16 14:22:58 2021] GET /identity/v3/endpoints?service_id=3c3433d1bbb44c37bce95515256e1315&interface=public®ion_id=RegionOne => generated 194 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:22:58.959876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846923fb-7867-4894-89ed-2afd56f7a9f9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:22:58.979121 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846923fb-7867-4894-89ed-2afd56f7a9f9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:22:58.986351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b05f6a-5941-46e5-80cf-504fc67e1d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:22:58.987278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05f6a-5941-46e5-80cf-504fc67e1d79 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:22:58.987571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05f6a-5941-46e5-80cf-504fc67e1d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:22:58.987849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05f6a-5941-46e5-80cf-504fc67e1d79 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:22:58.988526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b05f6a-5941-46e5-80cf-504fc67e1d79 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:22:59.014438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b05f6a-5941-46e5-80cf-504fc67e1d79 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:22:59.021245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 370/741] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:22:58 2021] GET /identity/v3/services => generated 1261 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:23:00.973596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89ffdf-e8f2-4fa0-a8c8-8db949f7f2d9 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:00.974233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89ffdf-e8f2-4fa0-a8c8-8db949f7f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:00.974233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89ffdf-e8f2-4fa0-a8c8-8db949f7f2d9 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:00.976172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 372/742] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:00.982317 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1f6b4-41d7-423a-8ad9-8a40d2ed9f89 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:00.982795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1f6b4-41d7-423a-8ad9-8a40d2ed9f89 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:00.982883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1f6b4-41d7-423a-8ad9-8a40d2ed9f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:01.010959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-0aa1f6b4-41d7-423a-8ad9-8a40d2ed9f89 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:01.012154 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-0aa1f6b4-41d7-423a-8ad9-8a40d2ed9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:01.023746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 371/743] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:00 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:01.046561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89ffdf-e8f2-4fa0-a8c8-8db949f7f2d9 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:01.059651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89ffdf-e8f2-4fa0-a8c8-8db949f7f2d9 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:01.063890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f4ec3-2228-4362-8137-f359776c7c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:01.064673 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f4ec3-2228-4362-8137-f359776c7c13 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:01.064961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f4ec3-2228-4362-8137-f359776c7c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:01.065239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f4ec3-2228-4362-8137-f359776c7c13 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:01.065877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f4ec3-2228-4362-8137-f359776c7c13 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:01.091553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f4ec3-2228-4362-8137-f359776c7c13 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:01.103958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-480f4ec3-2228-4362-8137-f359776c7c13 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 16 14:23:01.105138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 373/744] 10.222.0.67 () {56 vars in 1150 bytes} [Thu Dec 16 14:23:01 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:01.111296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1f6b4-41d7-423a-8ad9-8a40d2ed9f89 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:01.120600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1f6b4-41d7-423a-8ad9-8a40d2ed9f89 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:01.125600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed64d2f-edd2-4f7d-92be-d7db42797775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:01.126241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed64d2f-edd2-4f7d-92be-d7db42797775 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:01.126531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed64d2f-edd2-4f7d-92be-d7db42797775 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:01.126811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed64d2f-edd2-4f7d-92be-d7db42797775 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:01.127517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed64d2f-edd2-4f7d-92be-d7db42797775 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:01.127816 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed64d2f-edd2-4f7d-92be-d7db42797775 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:01.153599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed64d2f-edd2-4f7d-92be-d7db42797775 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:01.159087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 372/745] 10.222.0.67 () {56 vars in 1145 bytes} [Thu Dec 16 14:23:01 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:01.165538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f4ec3-2228-4362-8137-f359776c7c13 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:01.175560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f4ec3-2228-4362-8137-f359776c7c13 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:01.180677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3421b-74fa-4ccd-a9a0-0f0f0fc83738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:01.181265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3421b-74fa-4ccd-a9a0-0f0f0fc83738 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:01.181583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3421b-74fa-4ccd-a9a0-0f0f0fc83738 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:01.181850 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3421b-74fa-4ccd-a9a0-0f0f0fc83738 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:01.182573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3421b-74fa-4ccd-a9a0-0f0f0fc83738 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:01.182868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3421b-74fa-4ccd-a9a0-0f0f0fc83738 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:01.208143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3421b-74fa-4ccd-a9a0-0f0f0fc83738 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:01.213503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 374/746] 10.222.0.67 () {56 vars in 1145 bytes} [Thu Dec 16 14:23:01 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:01.219650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed64d2f-edd2-4f7d-92be-d7db42797775 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:01.231195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed64d2f-edd2-4f7d-92be-d7db42797775 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:01.236900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6b79c-d90e-4443-89e1-aa5548a74e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:01.237495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b79c-d90e-4443-89e1-aa5548a74e55 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:01.237778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b79c-d90e-4443-89e1-aa5548a74e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:01.238056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b79c-d90e-4443-89e1-aa5548a74e55 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:01.238769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6b79c-d90e-4443-89e1-aa5548a74e55 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:01.264531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6b79c-d90e-4443-89e1-aa5548a74e55 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:01.286541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 373/747] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:23:01 2021] POST /identity/v3/endpoints => generated 346 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:03.346077 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239fff-16f3-4892-9457-92cc58ba1007 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:03.346625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239fff-16f3-4892-9457-92cc58ba1007 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:03.346625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239fff-16f3-4892-9457-92cc58ba1007 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:03.348354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 375/748] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:03.354089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aad9bb-a403-4da9-92d4-331e449b077c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:03.354536 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aad9bb-a403-4da9-92d4-331e449b077c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:03.354623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aad9bb-a403-4da9-92d4-331e449b077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:03.378189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-33aad9bb-a403-4da9-92d4-331e449b077c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:03.379327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-33aad9bb-a403-4da9-92d4-331e449b077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:03.398051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 374/749] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:03 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:03.424256 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d239fff-16f3-4892-9457-92cc58ba1007 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:03.438153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d239fff-16f3-4892-9457-92cc58ba1007 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:03.442996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba3b71-5043-4e0c-8145-3dbcd30a2aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:03.443838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba3b71-5043-4e0c-8145-3dbcd30a2aec admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:03.444145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba3b71-5043-4e0c-8145-3dbcd30a2aec admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:03.444424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba3b71-5043-4e0c-8145-3dbcd30a2aec admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:03.445053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba3b71-5043-4e0c-8145-3dbcd30a2aec admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:03.470450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba3b71-5043-4e0c-8145-3dbcd30a2aec admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:03.482534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-15ba3b71-5043-4e0c-8145-3dbcd30a2aec admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Dec 16 14:23:03.483674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 376/750] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:03 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:03.489891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aad9bb-a403-4da9-92d4-331e449b077c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:03.499094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aad9bb-a403-4da9-92d4-331e449b077c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:03.504390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecef0c3-531b-44c9-a1ba-3c7588c869ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:03.504992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecef0c3-531b-44c9-a1ba-3c7588c869ee admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:03.505271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecef0c3-531b-44c9-a1ba-3c7588c869ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:03.505529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecef0c3-531b-44c9-a1ba-3c7588c869ee admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:03.506594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecef0c3-531b-44c9-a1ba-3c7588c869ee admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:03.506894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecef0c3-531b-44c9-a1ba-3c7588c869ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:03.532253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecef0c3-531b-44c9-a1ba-3c7588c869ee admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:03.537740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 375/751] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:03 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:03.543824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba3b71-5043-4e0c-8145-3dbcd30a2aec admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:03.555325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba3b71-5043-4e0c-8145-3dbcd30a2aec admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:03.560685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73493db1-f5f8-44d6-80d1-7da833337dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:03.561290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493db1-f5f8-44d6-80d1-7da833337dbd admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:03.561572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493db1-f5f8-44d6-80d1-7da833337dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:03.561841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493db1-f5f8-44d6-80d1-7da833337dbd admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:03.562554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73493db1-f5f8-44d6-80d1-7da833337dbd admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:03.562851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73493db1-f5f8-44d6-80d1-7da833337dbd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:03.588372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73493db1-f5f8-44d6-80d1-7da833337dbd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:03.593288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 377/752] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:03 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:05.556953 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e994dd1-503a-4115-bdac-f48d76becaf5 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:05.557467 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e994dd1-503a-4115-bdac-f48d76becaf5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:05.557467 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e994dd1-503a-4115-bdac-f48d76becaf5 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:05.559184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 376/753] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:05.564633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6520f-7792-4520-8f78-fa6332fb5455 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:05.565073 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6520f-7792-4520-8f78-fa6332fb5455 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:05.565204 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6520f-7792-4520-8f78-fa6332fb5455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:05.590369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-e9f6520f-7792-4520-8f78-fa6332fb5455 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:05.591517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e9f6520f-7792-4520-8f78-fa6332fb5455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:05.600147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 378/754] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:05 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:05.622337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e994dd1-503a-4115-bdac-f48d76becaf5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:05.636393 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e994dd1-503a-4115-bdac-f48d76becaf5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:05.641364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ea74a-3c30-410b-8bb0-deb759d62d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:05.641959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ea74a-3c30-410b-8bb0-deb759d62d22 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:05.642270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ea74a-3c30-410b-8bb0-deb759d62d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:05.642544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ea74a-3c30-410b-8bb0-deb759d62d22 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:05.643209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ea74a-3c30-410b-8bb0-deb759d62d22 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:05.668876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ea74a-3c30-410b-8bb0-deb759d62d22 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:05.686024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 377/755] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:23:05 2021] POST /identity/v3/services => generated 251 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:07.710153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b83e-3f51-4e2d-b47f-34eec876e3f4 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:07.710710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b83e-3f51-4e2d-b47f-34eec876e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:07.710710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0b83e-3f51-4e2d-b47f-34eec876e3f4 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:07.712373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 379/756] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:07.717874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebdd2b-4212-450b-8348-418bf2b48888 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:07.718415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebdd2b-4212-450b-8348-418bf2b48888 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:07.718415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebdd2b-4212-450b-8348-418bf2b48888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:07.750492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e8ebdd2b-4212-450b-8348-418bf2b48888 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:07.752522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e8ebdd2b-4212-450b-8348-418bf2b48888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:07.775442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 378/757] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:07 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:07.800555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0b83e-3f51-4e2d-b47f-34eec876e3f4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:07.815786 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0b83e-3f51-4e2d-b47f-34eec876e3f4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:07.821005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238ed9d-4166-49f8-86cb-8ff07fe6641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:07.821445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238ed9d-4166-49f8-86cb-8ff07fe6641f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:07.821730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238ed9d-4166-49f8-86cb-8ff07fe6641f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:07.822019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238ed9d-4166-49f8-86cb-8ff07fe6641f admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:07.822688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238ed9d-4166-49f8-86cb-8ff07fe6641f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:07.849003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238ed9d-4166-49f8-86cb-8ff07fe6641f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:07.863725 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-b238ed9d-4166-49f8-86cb-8ff07fe6641f admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Dec 16 14:23:07.864879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 380/758] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:07 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:07.873015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebdd2b-4212-450b-8348-418bf2b48888 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:07.887101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebdd2b-4212-450b-8348-418bf2b48888 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:07.897776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe152-abdf-41cb-940c-563239eefecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:07.898848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe152-abdf-41cb-940c-563239eefecf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:07.899294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe152-abdf-41cb-940c-563239eefecf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:07.899648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe152-abdf-41cb-940c-563239eefecf admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:07.900342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe152-abdf-41cb-940c-563239eefecf admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:07.900641 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe152-abdf-41cb-940c-563239eefecf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:07.934198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe152-abdf-41cb-940c-563239eefecf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:07.946137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 379/759] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:07 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:07.954325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238ed9d-4166-49f8-86cb-8ff07fe6641f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:07.964608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238ed9d-4166-49f8-86cb-8ff07fe6641f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:07.970441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63ceac-6e53-4fd2-9db2-6401db17151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:07.971039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63ceac-6e53-4fd2-9db2-6401db17151b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:07.971321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63ceac-6e53-4fd2-9db2-6401db17151b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:07.971598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63ceac-6e53-4fd2-9db2-6401db17151b admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:07.972284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63ceac-6e53-4fd2-9db2-6401db17151b admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:07.972579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63ceac-6e53-4fd2-9db2-6401db17151b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:07.998205 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63ceac-6e53-4fd2-9db2-6401db17151b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:08.003917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 381/760] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:07 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:08.011182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe152-abdf-41cb-940c-563239eefecf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:08.022596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe152-abdf-41cb-940c-563239eefecf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:08.028018 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25093ad1-c262-4838-8c5e-16dbc7cc3f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:08.028598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25093ad1-c262-4838-8c5e-16dbc7cc3f59 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:08.028894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25093ad1-c262-4838-8c5e-16dbc7cc3f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:08.029171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25093ad1-c262-4838-8c5e-16dbc7cc3f59 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:08.029923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25093ad1-c262-4838-8c5e-16dbc7cc3f59 admin admin] RBAC: Adding query filter params (interface=public, service_id=f16691bd1d1e4613af14d8e1845dc34e, region_id=RegionOne) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:08.030259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25093ad1-c262-4838-8c5e-16dbc7cc3f59 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:08.056133 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25093ad1-c262-4838-8c5e-16dbc7cc3f59 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:08.062602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 380/761] 10.222.0.67 () {56 vars in 1272 bytes} [Thu Dec 16 14:23:08 2021] GET /identity/v3/endpoints?service_id=f16691bd1d1e4613af14d8e1845dc34e&interface=public®ion_id=RegionOne => generated 194 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:08.068641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63ceac-6e53-4fd2-9db2-6401db17151b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:08.078534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63ceac-6e53-4fd2-9db2-6401db17151b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:08.083916 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7196a-0d31-4d1b-bcf2-3c65b951f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:08.084601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7196a-0d31-4d1b-bcf2-3c65b951f2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:08.084844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7196a-0d31-4d1b-bcf2-3c65b951f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:08.085138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7196a-0d31-4d1b-bcf2-3c65b951f2a3 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:08.085808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7196a-0d31-4d1b-bcf2-3c65b951f2a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:08.111232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7196a-0d31-4d1b-bcf2-3c65b951f2a3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:08.118066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 382/762] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:23:08 2021] GET /identity/v3/services => generated 1500 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:23:10.083940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f783e-6bec-48de-9601-f67fa7c6571c None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:10.084572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f783e-6bec-48de-9601-f67fa7c6571c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:10.084572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f783e-6bec-48de-9601-f67fa7c6571c None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:10.086320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 381/763] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:10.092432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9ca1-0452-4c1c-97cc-32c1474024ea None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:10.092963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9ca1-0452-4c1c-97cc-32c1474024ea None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:10.092963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e9ca1-0452-4c1c-97cc-32c1474024ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:10.117141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5b8e9ca1-0452-4c1c-97cc-32c1474024ea None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:10.118476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5b8e9ca1-0452-4c1c-97cc-32c1474024ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:10.125952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 383/764] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:10 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:10.148457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f783e-6bec-48de-9601-f67fa7c6571c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:10.162601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f783e-6bec-48de-9601-f67fa7c6571c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:10.167672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f3064-2991-453e-8eb2-088f6171af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:10.168446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3064-2991-453e-8eb2-088f6171af89 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:10.168722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3064-2991-453e-8eb2-088f6171af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:10.169000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3064-2991-453e-8eb2-088f6171af89 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:10.169620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f3064-2991-453e-8eb2-088f6171af89 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:10.195529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f3064-2991-453e-8eb2-088f6171af89 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:10.206884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-7b7f3064-2991-453e-8eb2-088f6171af89 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Dec 16 14:23:10.207985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 382/765] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:10 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:10.214301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9ca1-0452-4c1c-97cc-32c1474024ea None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:10.223094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e9ca1-0452-4c1c-97cc-32c1474024ea None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:10.227831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933adf41-465c-4070-8b06-7dedc4c215d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:10.228432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933adf41-465c-4070-8b06-7dedc4c215d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:10.228710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933adf41-465c-4070-8b06-7dedc4c215d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:10.228981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933adf41-465c-4070-8b06-7dedc4c215d1 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:10.229678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933adf41-465c-4070-8b06-7dedc4c215d1 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:10.229967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933adf41-465c-4070-8b06-7dedc4c215d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:10.255057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933adf41-465c-4070-8b06-7dedc4c215d1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:10.260148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 384/766] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:10 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:10.265950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f3064-2991-453e-8eb2-088f6171af89 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:10.276159 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f3064-2991-453e-8eb2-088f6171af89 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:10.281444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670de7b7-4a73-4d32-812f-78d949af9727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:10.282103 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670de7b7-4a73-4d32-812f-78d949af9727 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:10.282386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670de7b7-4a73-4d32-812f-78d949af9727 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:10.282655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670de7b7-4a73-4d32-812f-78d949af9727 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:10.283319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670de7b7-4a73-4d32-812f-78d949af9727 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:10.283614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670de7b7-4a73-4d32-812f-78d949af9727 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:10.309456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670de7b7-4a73-4d32-812f-78d949af9727 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:10.314651 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 383/767] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:10 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:10.320651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933adf41-465c-4070-8b06-7dedc4c215d1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:10.330479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933adf41-465c-4070-8b06-7dedc4c215d1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:10.335517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58d480-90da-4b32-89f4-bd8b606162b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:10.336028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d480-90da-4b32-89f4-bd8b606162b1 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:10.336304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d480-90da-4b32-89f4-bd8b606162b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:10.336573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d480-90da-4b32-89f4-bd8b606162b1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:10.337253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58d480-90da-4b32-89f4-bd8b606162b1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:10.362561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58d480-90da-4b32-89f4-bd8b606162b1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:10.382945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 385/768] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:23:10 2021] POST /identity/v3/endpoints => generated 346 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:12.362333 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d437df-7c2b-4d86-9dba-05352a3a44fa None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:12.362947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d437df-7c2b-4d86-9dba-05352a3a44fa None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:12.362947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d437df-7c2b-4d86-9dba-05352a3a44fa None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:12.364593 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 384/769] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:12.370259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1b849-2796-4efc-b9ed-9e8d113cb588 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:12.370746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1b849-2796-4efc-b9ed-9e8d113cb588 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:12.370871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1b849-2796-4efc-b9ed-9e8d113cb588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:12.393937 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-fab1b849-2796-4efc-b9ed-9e8d113cb588 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:12.395018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-fab1b849-2796-4efc-b9ed-9e8d113cb588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:12.413123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 386/770] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:12 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:12.436096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d437df-7c2b-4d86-9dba-05352a3a44fa None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:12.452349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d437df-7c2b-4d86-9dba-05352a3a44fa None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:12.457153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149132ef-4a61-456f-a20d-2d10c2a64cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:12.457888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149132ef-4a61-456f-a20d-2d10c2a64cae admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:12.458228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149132ef-4a61-456f-a20d-2d10c2a64cae admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:12.458507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149132ef-4a61-456f-a20d-2d10c2a64cae admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:12.459133 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149132ef-4a61-456f-a20d-2d10c2a64cae admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:12.492912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149132ef-4a61-456f-a20d-2d10c2a64cae admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:12.504187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-149132ef-4a61-456f-a20d-2d10c2a64cae admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 16 14:23:12.505363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 385/771] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:12 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:12.512443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1b849-2796-4efc-b9ed-9e8d113cb588 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:12.522403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1b849-2796-4efc-b9ed-9e8d113cb588 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:12.527816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa00d7e-4ff5-4334-89c4-3a60aea6bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:12.528438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa00d7e-4ff5-4334-89c4-3a60aea6bde7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:12.528713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa00d7e-4ff5-4334-89c4-3a60aea6bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:12.528988 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa00d7e-4ff5-4334-89c4-3a60aea6bde7 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:12.529688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa00d7e-4ff5-4334-89c4-3a60aea6bde7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:12.530012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa00d7e-4ff5-4334-89c4-3a60aea6bde7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:12.556740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa00d7e-4ff5-4334-89c4-3a60aea6bde7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:12.562869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 387/772] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:12 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:12.569126 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149132ef-4a61-456f-a20d-2d10c2a64cae admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:12.580786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149132ef-4a61-456f-a20d-2d10c2a64cae admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:12.586551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46645fa-9757-49a0-bb55-f611b958590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:12.587166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46645fa-9757-49a0-bb55-f611b958590f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:12.587425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46645fa-9757-49a0-bb55-f611b958590f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:12.587698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46645fa-9757-49a0-bb55-f611b958590f admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:12.588386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46645fa-9757-49a0-bb55-f611b958590f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:12.588689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46645fa-9757-49a0-bb55-f611b958590f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:12.614505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46645fa-9757-49a0-bb55-f611b958590f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:12.620237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 386/773] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:12 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:14.613537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4d41-21ff-4c46-af79-396bb5df8c43 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:14.614165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4d41-21ff-4c46-af79-396bb5df8c43 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:14.614165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4d41-21ff-4c46-af79-396bb5df8c43 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:14.615803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 388/774] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:14.621295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee504e-bbc5-4c99-bf12-84bf9930dbe3 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:14.621784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee504e-bbc5-4c99-bf12-84bf9930dbe3 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:14.621881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee504e-bbc5-4c99-bf12-84bf9930dbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:14.645483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-96ee504e-bbc5-4c99-bf12-84bf9930dbe3 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:14.646654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-96ee504e-bbc5-4c99-bf12-84bf9930dbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:14.655209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 387/775] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:14 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:14.678164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4d41-21ff-4c46-af79-396bb5df8c43 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:14.691519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4d41-21ff-4c46-af79-396bb5df8c43 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:14.696619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69b9f9-d19d-4674-83d4-e0868e9bc4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:14.697224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69b9f9-d19d-4674-83d4-e0868e9bc4bd admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:14.697513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69b9f9-d19d-4674-83d4-e0868e9bc4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:14.697795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69b9f9-d19d-4674-83d4-e0868e9bc4bd admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:14.698538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69b9f9-d19d-4674-83d4-e0868e9bc4bd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:14.724023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69b9f9-d19d-4674-83d4-e0868e9bc4bd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:14.740281 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 389/776] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:23:14 2021] POST /identity/v3/services => generated 251 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:16.715257 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dbc07-082c-4b5f-9598-bad2e345e065 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.715905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dbc07-082c-4b5f-9598-bad2e345e065 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.715905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dbc07-082c-4b5f-9598-bad2e345e065 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.717682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 388/777] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:16.723061 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4842c-27a0-4f34-b939-11c30fd6e2f3 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.723514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4842c-27a0-4f34-b939-11c30fd6e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.723601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4842c-27a0-4f34-b939-11c30fd6e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.748300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-21e4842c-27a0-4f34-b939-11c30fd6e2f3 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:16.749676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-21e4842c-27a0-4f34-b939-11c30fd6e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:16.769180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 390/778] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:16 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:16.791859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dbc07-082c-4b5f-9598-bad2e345e065 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.805964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dbc07-082c-4b5f-9598-bad2e345e065 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.810920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ea8e9-8779-44a6-bced-90dc2118ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.811649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ea8e9-8779-44a6-bced-90dc2118ec85 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.811928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ea8e9-8779-44a6-bced-90dc2118ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.812201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ea8e9-8779-44a6-bced-90dc2118ec85 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.812852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ea8e9-8779-44a6-bced-90dc2118ec85 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:16.838813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ea8e9-8779-44a6-bced-90dc2118ec85 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:16.850205 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-6b4ea8e9-8779-44a6-bced-90dc2118ec85 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 16 14:23:16.851600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 389/779] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:16.857958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4842c-27a0-4f34-b939-11c30fd6e2f3 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.867340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4842c-27a0-4f34-b939-11c30fd6e2f3 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.871992 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bfb5f-e1c9-4c66-bee9-306ec84487d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.872585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bfb5f-e1c9-4c66-bee9-306ec84487d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.872865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bfb5f-e1c9-4c66-bee9-306ec84487d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.873143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bfb5f-e1c9-4c66-bee9-306ec84487d3 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.873851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bfb5f-e1c9-4c66-bee9-306ec84487d3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:16.874171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bfb5f-e1c9-4c66-bee9-306ec84487d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:16.900322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bfb5f-e1c9-4c66-bee9-306ec84487d3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:16.905694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 391/780] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:16.911854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ea8e9-8779-44a6-bced-90dc2118ec85 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.922429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ea8e9-8779-44a6-bced-90dc2118ec85 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.928231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d237c-fd55-47d7-a9eb-dde3d22890c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.929192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d237c-fd55-47d7-a9eb-dde3d22890c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.929462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d237c-fd55-47d7-a9eb-dde3d22890c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.929737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d237c-fd55-47d7-a9eb-dde3d22890c0 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.930451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d237c-fd55-47d7-a9eb-dde3d22890c0 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:16.930751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d237c-fd55-47d7-a9eb-dde3d22890c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:16.956092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d237c-fd55-47d7-a9eb-dde3d22890c0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:16.961730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 390/781] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:16.967956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bfb5f-e1c9-4c66-bee9-306ec84487d3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:16.977770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bfb5f-e1c9-4c66-bee9-306ec84487d3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:16.982410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bc298-7787-477c-9b6c-6e522ed66243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:16.983000 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc298-7787-477c-9b6c-6e522ed66243 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:16.983285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc298-7787-477c-9b6c-6e522ed66243 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:16.983568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bc298-7787-477c-9b6c-6e522ed66243 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:16.984341 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bc298-7787-477c-9b6c-6e522ed66243 admin admin] RBAC: Adding query filter params (interface=public, service_id=51874cff21b7461682c3673495db1272, region_id=RegionOne) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:16.984646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bc298-7787-477c-9b6c-6e522ed66243 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:17.009923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bc298-7787-477c-9b6c-6e522ed66243 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:17.015592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 392/782] 10.222.0.67 () {56 vars in 1272 bytes} [Thu Dec 16 14:23:16 2021] GET /identity/v3/endpoints?service_id=51874cff21b7461682c3673495db1272&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:17.021423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d237c-fd55-47d7-a9eb-dde3d22890c0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:17.031389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d237c-fd55-47d7-a9eb-dde3d22890c0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:17.036337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0431e-e9fd-4974-be4c-edee24049ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:17.036942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0431e-e9fd-4974-be4c-edee24049ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:17.037224 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0431e-e9fd-4974-be4c-edee24049ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:17.037501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0431e-e9fd-4974-be4c-edee24049ff4 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:17.038271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0431e-e9fd-4974-be4c-edee24049ff4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:17.063866 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0431e-e9fd-4974-be4c-edee24049ff4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:17.070814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 391/783] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:23:17 2021] GET /identity/v3/services => generated 1739 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:23:19.056894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce650-9f49-4e3b-aaf1-2ddca1d641d0 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:19.057470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce650-9f49-4e3b-aaf1-2ddca1d641d0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:19.057470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce650-9f49-4e3b-aaf1-2ddca1d641d0 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:19.059189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 393/784] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:19.064553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0576b-be5d-4022-a2ff-50bf7465ee5a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:19.064984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0576b-be5d-4022-a2ff-50bf7465ee5a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:19.065088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0576b-be5d-4022-a2ff-50bf7465ee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:19.089230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e7c0576b-be5d-4022-a2ff-50bf7465ee5a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:19.090421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e7c0576b-be5d-4022-a2ff-50bf7465ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:19.098160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 392/785] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:19 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:19.121243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ce650-9f49-4e3b-aaf1-2ddca1d641d0 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:19.135675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ce650-9f49-4e3b-aaf1-2ddca1d641d0 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:19.140836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56b523-826b-412e-aab8-2bb6a56bd101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:19.141596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b523-826b-412e-aab8-2bb6a56bd101 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:19.141884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b523-826b-412e-aab8-2bb6a56bd101 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:19.142195 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b523-826b-412e-aab8-2bb6a56bd101 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:19.142833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56b523-826b-412e-aab8-2bb6a56bd101 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:19.168609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56b523-826b-412e-aab8-2bb6a56bd101 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:19.181320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-4a56b523-826b-412e-aab8-2bb6a56bd101 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 16 14:23:19.183247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 394/786] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:19 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:19.190713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0576b-be5d-4022-a2ff-50bf7465ee5a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:19.201757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0576b-be5d-4022-a2ff-50bf7465ee5a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:19.209189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e3e42-92f0-4400-bb37-33f585412f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:19.210147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e3e42-92f0-4400-bb37-33f585412f05 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:19.210526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e3e42-92f0-4400-bb37-33f585412f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:19.210893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e3e42-92f0-4400-bb37-33f585412f05 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:19.211949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e3e42-92f0-4400-bb37-33f585412f05 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:19.212364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e3e42-92f0-4400-bb37-33f585412f05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:19.243381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e3e42-92f0-4400-bb37-33f585412f05 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:19.248921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 393/787] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:19 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:19.255034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56b523-826b-412e-aab8-2bb6a56bd101 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:19.265306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56b523-826b-412e-aab8-2bb6a56bd101 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:19.270741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b1692-6900-40f0-8b04-e2851777f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:19.271320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1692-6900-40f0-8b04-e2851777f968 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:19.271600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1692-6900-40f0-8b04-e2851777f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:19.271877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1692-6900-40f0-8b04-e2851777f968 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:19.272602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b1692-6900-40f0-8b04-e2851777f968 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:19.272901 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b1692-6900-40f0-8b04-e2851777f968 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:19.298664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b1692-6900-40f0-8b04-e2851777f968 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:19.303953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 395/788] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:19 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:19.309766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e3e42-92f0-4400-bb37-33f585412f05 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:19.319724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e3e42-92f0-4400-bb37-33f585412f05 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:19.325130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c5e31-5f5b-4352-9728-9e67a100d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:19.325718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c5e31-5f5b-4352-9728-9e67a100d805 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:19.326031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c5e31-5f5b-4352-9728-9e67a100d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:19.326395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c5e31-5f5b-4352-9728-9e67a100d805 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:19.327091 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c5e31-5f5b-4352-9728-9e67a100d805 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:19.352395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c5e31-5f5b-4352-9728-9e67a100d805 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:19.375204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 394/789] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:23:19 2021] POST /identity/v3/endpoints => generated 346 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:21.348240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8156bb-23b8-4500-8788-84fac2f84b27 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.348848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8156bb-23b8-4500-8788-84fac2f84b27 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.348848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8156bb-23b8-4500-8788-84fac2f84b27 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.350649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 396/790] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:21.355873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4cf21-df2e-481b-8b4f-368fb5de84b0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.356495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4cf21-df2e-481b-8b4f-368fb5de84b0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.356495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4cf21-df2e-481b-8b4f-368fb5de84b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.379340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2dc4cf21-df2e-481b-8b4f-368fb5de84b0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:21.380496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2dc4cf21-df2e-481b-8b4f-368fb5de84b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:21.398633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 395/791] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:21 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:21.421218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8156bb-23b8-4500-8788-84fac2f84b27 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:21.435123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8156bb-23b8-4500-8788-84fac2f84b27 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:21.439924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:21.440537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.440823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.441103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.441806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:21.467620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:21.469078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.common [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 16 14:23:21.488330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.sql.core [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 16 14:23:21.488330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 16 14:23:21.488330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [parameters: {'id': 'f8f68bf77e9945aa9a1fa6cffc133d61', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 16 14:23:21.488330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66113) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Dec 16 14:23:21.502385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8f68bf77e9945aa9a1fa6cffc133d61.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8f68bf77e9945aa9a1fa6cffc133d61. Dec 16 14:23:21.503661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 397/792] 10.222.0.67 () {60 vars in 1161 bytes} [Thu Dec 16 14:23:21 2021] POST /identity/v3/projects => generated 262 bytes in 83 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:21.510043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4cf21-df2e-481b-8b4f-368fb5de84b0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:21.519024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4cf21-df2e-481b-8b4f-368fb5de84b0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:21.524534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd568a3-2b04-4cb0-bbce-d2cfd6f52754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:21.525258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd568a3-2b04-4cb0-bbce-d2cfd6f52754 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.525536 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd568a3-2b04-4cb0-bbce-d2cfd6f52754 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.525806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd568a3-2b04-4cb0-bbce-d2cfd6f52754 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.534271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd568a3-2b04-4cb0-bbce-d2cfd6f52754 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:21.560729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd568a3-2b04-4cb0-bbce-d2cfd6f52754 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:21.576453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-9cd568a3-2b04-4cb0-bbce-d2cfd6f52754 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:21.577579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 396/793] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:21.583984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:21.594400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad0185-bbb1-4221-b2b5-006304ee2b8c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:21.599639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd414-c972-41ae-949f-cd8d7a1b6e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:21.600414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd414-c972-41ae-949f-cd8d7a1b6e43 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:21.600767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd414-c972-41ae-949f-cd8d7a1b6e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:21.601113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd414-c972-41ae-949f-cd8d7a1b6e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:21.601767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd414-c972-41ae-949f-cd8d7a1b6e43 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:21.602108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd414-c972-41ae-949f-cd8d7a1b6e43 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:21.628387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd414-c972-41ae-949f-cd8d7a1b6e43 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:21.646411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 398/794] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:23:21 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:23.654059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea887-41ae-4fbc-9f7c-41c23c103a73 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.654639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea887-41ae-4fbc-9f7c-41c23c103a73 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.654639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea887-41ae-4fbc-9f7c-41c23c103a73 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.656359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 397/795] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:23:23.663109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8feb08-9d22-44fc-8217-fbb5377eb4c1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.663921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8feb08-9d22-44fc-8217-fbb5377eb4c1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.664316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8feb08-9d22-44fc-8217-fbb5377eb4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.700784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1f8feb08-9d22-44fc-8217-fbb5377eb4c1 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:23.702322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1f8feb08-9d22-44fc-8217-fbb5377eb4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:23.711046 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 399/796] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:23 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:23.736321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ea887-41ae-4fbc-9f7c-41c23c103a73 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:23.751537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ea887-41ae-4fbc-9f7c-41c23c103a73 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:23.757833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:23.758491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.758777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.759044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.759689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:23.785624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:23.786996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.common [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 16 14:23:23.799909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.sql.core [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 16 14:23:23.799909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 16 14:23:23.799909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [parameters: {'user_id': '2ab25d01b24a45a49c20415eaf0667c5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 16 14:23:23.799909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66112) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Dec 16 14:23:23.814131 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 16 14:23:23.815608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 398/797] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:23:23 2021] POST /identity/v3/users => generated 160 bytes in 80 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:23.822330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8feb08-9d22-44fc-8217-fbb5377eb4c1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:23.831734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8feb08-9d22-44fc-8217-fbb5377eb4c1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:23.836380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3e2e1-68fe-484a-a291-59dc3298b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:23.837114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3e2e1-68fe-484a-a291-59dc3298b617 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.837386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3e2e1-68fe-484a-a291-59dc3298b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.837662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3e2e1-68fe-484a-a291-59dc3298b617 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.850691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3e2e1-68fe-484a-a291-59dc3298b617 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:23.879353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3e2e1-68fe-484a-a291-59dc3298b617 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:23.899633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-69d3e2e1-68fe-484a-a291-59dc3298b617 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 16 14:23:23.900883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 400/798] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:23 2021] GET /identity/v3/users/cinder => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:23.907704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:23.920658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fffd46-9fc2-40cb-9da7-d51abdb2ce2c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:23.925611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e823726-e0eb-4652-a182-26b98c8ea472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:23.926273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e823726-e0eb-4652-a182-26b98c8ea472 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:23.926571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e823726-e0eb-4652-a182-26b98c8ea472 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:23.926846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e823726-e0eb-4652-a182-26b98c8ea472 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:23.928428 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e823726-e0eb-4652-a182-26b98c8ea472 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:23.928910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e823726-e0eb-4652-a182-26b98c8ea472 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:23.960477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e823726-e0eb-4652-a182-26b98c8ea472 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:23.997085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 399/799] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Dec 16 14:23:23 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:26.092634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65c45-067b-4b74-bf41-c1bdebe02d7b None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.093226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65c45-067b-4b74-bf41-c1bdebe02d7b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.093226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65c45-067b-4b74-bf41-c1bdebe02d7b None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.094934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 401/800] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:26.100592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71e16b-2227-4234-ad35-fa89c1fe5c05 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.101029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71e16b-2227-4234-ad35-fa89c1fe5c05 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.101117 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71e16b-2227-4234-ad35-fa89c1fe5c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.125008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-0f71e16b-2227-4234-ad35-fa89c1fe5c05 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:26.126548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-0f71e16b-2227-4234-ad35-fa89c1fe5c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:26.135320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 400/801] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:26 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:26.159077 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b65c45-067b-4b74-bf41-c1bdebe02d7b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:26.172728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b65c45-067b-4b74-bf41-c1bdebe02d7b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:26.178055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3efd1d-031e-4b59-ac6c-7b806fa302d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:26.178775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3efd1d-031e-4b59-ac6c-7b806fa302d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.179071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3efd1d-031e-4b59-ac6c-7b806fa302d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.179344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3efd1d-031e-4b59-ac6c-7b806fa302d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.191934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3efd1d-031e-4b59-ac6c-7b806fa302d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:26.217709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3efd1d-031e-4b59-ac6c-7b806fa302d3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:26.236346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-bd3efd1d-031e-4b59-ac6c-7b806fa302d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:26.237537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 402/802] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:26.244277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71e16b-2227-4234-ad35-fa89c1fe5c05 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:26.253137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71e16b-2227-4234-ad35-fa89c1fe5c05 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:26.257842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef2f9d-90ea-46f5-8166-1ae52fdf9ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:26.258452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2f9d-90ea-46f5-8166-1ae52fdf9ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.258731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2f9d-90ea-46f5-8166-1ae52fdf9ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.259004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2f9d-90ea-46f5-8166-1ae52fdf9ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.259684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef2f9d-90ea-46f5-8166-1ae52fdf9ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:26.259977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef2f9d-90ea-46f5-8166-1ae52fdf9ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:26.285488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef2f9d-90ea-46f5-8166-1ae52fdf9ee5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:26.300269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 401/803] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:26.306720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3efd1d-031e-4b59-ac6c-7b806fa302d3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:26.316513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3efd1d-031e-4b59-ac6c-7b806fa302d3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:26.321110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214952d-b391-4317-9e2d-ddbc23f468bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:26.321704 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214952d-b391-4317-9e2d-ddbc23f468bc admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:26.322012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214952d-b391-4317-9e2d-ddbc23f468bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:26.322297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214952d-b391-4317-9e2d-ddbc23f468bc admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:26.322963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214952d-b391-4317-9e2d-ddbc23f468bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:26.348724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214952d-b391-4317-9e2d-ddbc23f468bc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:26.373477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 403/804] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:23:26 2021] POST /identity/v3/users => generated 249 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:23:28.381720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f2da-6794-4e3e-8d9f-9f72fa4e61a5 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.382308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f2da-6794-4e3e-8d9f-9f72fa4e61a5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.382308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f2da-6794-4e3e-8d9f-9f72fa4e61a5 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.383991 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 402/805] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:28.389470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1135eb-026f-4377-b230-497c9e93f11c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.389931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1135eb-026f-4377-b230-497c9e93f11c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.389931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1135eb-026f-4377-b230-497c9e93f11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.415085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5f1135eb-026f-4377-b230-497c9e93f11c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:28.416256 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5f1135eb-026f-4377-b230-497c9e93f11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:28.423034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 404/806] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:28 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:23:28.446710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205f2da-6794-4e3e-8d9f-9f72fa4e61a5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.460580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205f2da-6794-4e3e-8d9f-9f72fa4e61a5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.465649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db46fac-96d3-46e3-9324-bf97ebc558a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.466425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db46fac-96d3-46e3-9324-bf97ebc558a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.466709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db46fac-96d3-46e3-9324-bf97ebc558a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.466989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db46fac-96d3-46e3-9324-bf97ebc558a0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.479412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db46fac-96d3-46e3-9324-bf97ebc558a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:23:28.485913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-2db46fac-96d3-46e3-9324-bf97ebc558a0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:23:28.487085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 403/807] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:28.493443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1135eb-026f-4377-b230-497c9e93f11c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.502198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1135eb-026f-4377-b230-497c9e93f11c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.506716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f06893-036d-472a-a1aa-e8c230cd86e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.507332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f06893-036d-472a-a1aa-e8c230cd86e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.507614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f06893-036d-472a-a1aa-e8c230cd86e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.507880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f06893-036d-472a-a1aa-e8c230cd86e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.508592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f06893-036d-472a-a1aa-e8c230cd86e2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:28.508884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f06893-036d-472a-a1aa-e8c230cd86e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:28.534486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f06893-036d-472a-a1aa-e8c230cd86e2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.544083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 405/808] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:28.550005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db46fac-96d3-46e3-9324-bf97ebc558a0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.561728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db46fac-96d3-46e3-9324-bf97ebc558a0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.567072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da577837-88d3-4e0a-bbb9-ba90ac4fc43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.567873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577837-88d3-4e0a-bbb9-ba90ac4fc43a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.568300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577837-88d3-4e0a-bbb9-ba90ac4fc43a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.568714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577837-88d3-4e0a-bbb9-ba90ac4fc43a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.580358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da577837-88d3-4e0a-bbb9-ba90ac4fc43a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:28.606150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da577837-88d3-4e0a-bbb9-ba90ac4fc43a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.625912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-da577837-88d3-4e0a-bbb9-ba90ac4fc43a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:28.627122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 404/809] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:28.633240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f06893-036d-472a-a1aa-e8c230cd86e2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.643362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f06893-036d-472a-a1aa-e8c230cd86e2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.648955 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a266e-77ba-4a54-8b0e-74d44121f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.649565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a266e-77ba-4a54-8b0e-74d44121f721 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.649845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a266e-77ba-4a54-8b0e-74d44121f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.650147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a266e-77ba-4a54-8b0e-74d44121f721 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.650852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a266e-77ba-4a54-8b0e-74d44121f721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:28.651141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a266e-77ba-4a54-8b0e-74d44121f721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:28.676997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a266e-77ba-4a54-8b0e-74d44121f721 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.691518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 406/810] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:28.697547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da577837-88d3-4e0a-bbb9-ba90ac4fc43a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.707759 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da577837-88d3-4e0a-bbb9-ba90ac4fc43a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.713314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1125-cecd-464b-8564-dfadc3580d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.714085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1125-cecd-464b-8564-dfadc3580d39 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.714362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1125-cecd-464b-8564-dfadc3580d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.714634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1125-cecd-464b-8564-dfadc3580d39 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.728532 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1125-cecd-464b-8564-dfadc3580d39 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:28.754242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1125-cecd-464b-8564-dfadc3580d39 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.785982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-818c1125-cecd-464b-8564-dfadc3580d39 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 16 14:23:28.788849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 405/811] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/users/neutron => generated 85 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:28.795087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a266e-77ba-4a54-8b0e-74d44121f721 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.806123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a266e-77ba-4a54-8b0e-74d44121f721 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.811241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e0ec0-da69-40da-b0d7-12d1a6edf4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.811858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e0ec0-da69-40da-b0d7-12d1a6edf4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.812141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e0ec0-da69-40da-b0d7-12d1a6edf4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.812416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e0ec0-da69-40da-b0d7-12d1a6edf4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.813223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e0ec0-da69-40da-b0d7-12d1a6edf4b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:28.813524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e0ec0-da69-40da-b0d7-12d1a6edf4b7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:28.839902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e0ec0-da69-40da-b0d7-12d1a6edf4b7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.872388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 407/812] 10.222.0.67 () {56 vars in 1160 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:28.878435 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1125-cecd-464b-8564-dfadc3580d39 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.889027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1125-cecd-464b-8564-dfadc3580d39 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.894134 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8289db5-1bfb-4020-999d-ac16160adb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.894657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289db5-1bfb-4020-999d-ac16160adb0e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.894937 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289db5-1bfb-4020-999d-ac16160adb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.895209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289db5-1bfb-4020-999d-ac16160adb0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.903724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8289db5-1bfb-4020-999d-ac16160adb0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:28.929621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8289db5-1bfb-4020-999d-ac16160adb0e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:28.940885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 406/813] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:28.947291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e0ec0-da69-40da-b0d7-12d1a6edf4b7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:28.957424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e0ec0-da69-40da-b0d7-12d1a6edf4b7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:28.961693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2770d-b7b1-477e-9e34-c59e2a8f7063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:28.962503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2770d-b7b1-477e-9e34-c59e2a8f7063 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:28.962790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2770d-b7b1-477e-9e34-c59e2a8f7063 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:28.963070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2770d-b7b1-477e-9e34-c59e2a8f7063 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:28.975237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2770d-b7b1-477e-9e34-c59e2a8f7063 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:29.001023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2770d-b7b1-477e-9e34-c59e2a8f7063 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:29.024321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-b0b2770d-b7b1-477e-9e34-c59e2a8f7063 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:29.025489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 408/814] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:23:29.031578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8289db5-1bfb-4020-999d-ac16160adb0e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:29.040828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8289db5-1bfb-4020-999d-ac16160adb0e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:29.046278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79b061-29af-4f48-9928-cda2d56d8711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:29.046867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b061-29af-4f48-9928-cda2d56d8711 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:29.047151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b061-29af-4f48-9928-cda2d56d8711 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:29.047413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b061-29af-4f48-9928-cda2d56d8711 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:29.048098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79b061-29af-4f48-9928-cda2d56d8711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:29.048395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79b061-29af-4f48-9928-cda2d56d8711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:29.076205 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79b061-29af-4f48-9928-cda2d56d8711 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:29.092370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 407/815] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:29.098594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2770d-b7b1-477e-9e34-c59e2a8f7063 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:29.108878 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2770d-b7b1-477e-9e34-c59e2a8f7063 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:29.113090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dad878-0532-46f7-8991-2653064e77c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:29.113835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dad878-0532-46f7-8991-2653064e77c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:29.114158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dad878-0532-46f7-8991-2653064e77c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:29.114452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dad878-0532-46f7-8991-2653064e77c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:29.124774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dad878-0532-46f7-8991-2653064e77c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:29.150728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dad878-0532-46f7-8991-2653064e77c4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:29.165938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-c8dad878-0532-46f7-8991-2653064e77c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:29.167187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 409/816] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:29.173306 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79b061-29af-4f48-9928-cda2d56d8711 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:29.184381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79b061-29af-4f48-9928-cda2d56d8711 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:29.189896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e509-b17f-48da-999c-f5fb6e8aab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:29.190571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e509-b17f-48da-999c-f5fb6e8aab98 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:29.190856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e509-b17f-48da-999c-f5fb6e8aab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:29.191127 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e509-b17f-48da-999c-f5fb6e8aab98 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:29.192037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6e509-b17f-48da-999c-f5fb6e8aab98 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:29.192335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6e509-b17f-48da-999c-f5fb6e8aab98 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:29.219164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6e509-b17f-48da-999c-f5fb6e8aab98 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:29.233890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 408/817] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:29.240725 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dad878-0532-46f7-8991-2653064e77c4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:29.251198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dad878-0532-46f7-8991-2653064e77c4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:29.256324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5eb59-abcf-44ea-8f42-8228ef436265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:29.257004 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5eb59-abcf-44ea-8f42-8228ef436265 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:29.257299 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5eb59-abcf-44ea-8f42-8228ef436265 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:29.257574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5eb59-abcf-44ea-8f42-8228ef436265 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:29.258409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5eb59-abcf-44ea-8f42-8228ef436265 admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=20905ef1afa847bc8f2f6f6e335f8bd2) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:29.258700 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5eb59-abcf-44ea-8f42-8228ef436265 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:29.287423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5eb59-abcf-44ea-8f42-8228ef436265 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:29.293770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 410/818] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:23:29 2021] GET /identity/v3/role_assignments?user.id=20905ef1afa847bc8f2f6f6e335f8bd2&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:31.266386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014fb49-aef4-401a-b623-2f2b0e8857ab None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.266976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014fb49-aef4-401a-b623-2f2b0e8857ab None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.266976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014fb49-aef4-401a-b623-2f2b0e8857ab None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.268583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 409/819] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:31.274388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ce12f-7c6b-4196-9b95-8351475c6555 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.274896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ce12f-7c6b-4196-9b95-8351475c6555 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.274896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ce12f-7c6b-4196-9b95-8351475c6555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.300174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0c1ce12f-7c6b-4196-9b95-8351475c6555 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:31.301361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0c1ce12f-7c6b-4196-9b95-8351475c6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:31.308875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 411/820] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:31 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:23:31.330974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014fb49-aef4-401a-b623-2f2b0e8857ab None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.354590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014fb49-aef4-401a-b623-2f2b0e8857ab None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.359615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85064b2c-a139-4c65-8262-fda0b363406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.360361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85064b2c-a139-4c65-8262-fda0b363406f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.360642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85064b2c-a139-4c65-8262-fda0b363406f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.360919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85064b2c-a139-4c65-8262-fda0b363406f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.375454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85064b2c-a139-4c65-8262-fda0b363406f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:23:31.382025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-85064b2c-a139-4c65-8262-fda0b363406f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:23:31.383166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 410/821] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:31.389694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ce12f-7c6b-4196-9b95-8351475c6555 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.398340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ce12f-7c6b-4196-9b95-8351475c6555 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.402702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b2616-a79b-43f9-b5b6-1acc3a41044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.403294 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b2616-a79b-43f9-b5b6-1acc3a41044f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.403573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b2616-a79b-43f9-b5b6-1acc3a41044f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.403842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b2616-a79b-43f9-b5b6-1acc3a41044f admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.404556 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b2616-a79b-43f9-b5b6-1acc3a41044f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:31.404856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b2616-a79b-43f9-b5b6-1acc3a41044f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:31.430485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b2616-a79b-43f9-b5b6-1acc3a41044f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:31.440387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 412/822] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:31.446444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85064b2c-a139-4c65-8262-fda0b363406f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.456651 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85064b2c-a139-4c65-8262-fda0b363406f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.461381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaed8e3-ac8f-4549-bdf9-8c93738e2bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.462105 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaed8e3-ac8f-4549-bdf9-8c93738e2bfe admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.462400 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaed8e3-ac8f-4549-bdf9-8c93738e2bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.462673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaed8e3-ac8f-4549-bdf9-8c93738e2bfe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.474424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaed8e3-ac8f-4549-bdf9-8c93738e2bfe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:31.500006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaed8e3-ac8f-4549-bdf9-8c93738e2bfe admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:31.518523 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-0aaed8e3-ac8f-4549-bdf9-8c93738e2bfe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:31.519627 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 411/823] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:23:31.525588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b2616-a79b-43f9-b5b6-1acc3a41044f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.535598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b2616-a79b-43f9-b5b6-1acc3a41044f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.540984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c100ed-5fa7-45fd-90d5-5d9bded12cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.541581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c100ed-5fa7-45fd-90d5-5d9bded12cbd admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.541865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c100ed-5fa7-45fd-90d5-5d9bded12cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.542179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c100ed-5fa7-45fd-90d5-5d9bded12cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.542884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c100ed-5fa7-45fd-90d5-5d9bded12cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:31.543183 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c100ed-5fa7-45fd-90d5-5d9bded12cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:31.569197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c100ed-5fa7-45fd-90d5-5d9bded12cbd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:31.582813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 413/824] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:31.588898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaed8e3-ac8f-4549-bdf9-8c93738e2bfe admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.598657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaed8e3-ac8f-4549-bdf9-8c93738e2bfe admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.603572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8901b93-6776-462f-aad2-ed2ee88fc42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.604308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901b93-6776-462f-aad2-ed2ee88fc42e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.604586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901b93-6776-462f-aad2-ed2ee88fc42e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.604858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901b93-6776-462f-aad2-ed2ee88fc42e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.620219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8901b93-6776-462f-aad2-ed2ee88fc42e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:31.646146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8901b93-6776-462f-aad2-ed2ee88fc42e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:31.665305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-e8901b93-6776-462f-aad2-ed2ee88fc42e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 16 14:23:31.666489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 412/825] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/users/neutron => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:31.672630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c100ed-5fa7-45fd-90d5-5d9bded12cbd admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.684577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c100ed-5fa7-45fd-90d5-5d9bded12cbd admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.690162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67584cc-6335-479c-97c9-12fb01996bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.690802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67584cc-6335-479c-97c9-12fb01996bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.691084 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67584cc-6335-479c-97c9-12fb01996bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.691357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67584cc-6335-479c-97c9-12fb01996bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.692190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67584cc-6335-479c-97c9-12fb01996bc4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:31.693018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67584cc-6335-479c-97c9-12fb01996bc4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:31.719281 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67584cc-6335-479c-97c9-12fb01996bc4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:31.750443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 414/826] 10.222.0.67 () {56 vars in 1160 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:31.756745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8901b93-6776-462f-aad2-ed2ee88fc42e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.766841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8901b93-6776-462f-aad2-ed2ee88fc42e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.772445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf2fb4-6058-433f-9240-6c0f18336e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.773176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf2fb4-6058-433f-9240-6c0f18336e6b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.773451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf2fb4-6058-433f-9240-6c0f18336e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.773724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf2fb4-6058-433f-9240-6c0f18336e6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.786962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf2fb4-6058-433f-9240-6c0f18336e6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:31.812857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf2fb4-6058-433f-9240-6c0f18336e6b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:31.831320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-7cbf2fb4-6058-433f-9240-6c0f18336e6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:31.832465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 413/827] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:31.838605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67584cc-6335-479c-97c9-12fb01996bc4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.849127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67584cc-6335-479c-97c9-12fb01996bc4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.853756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0af94-5ed8-4527-a3ce-0f3cea46fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.854393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0af94-5ed8-4527-a3ce-0f3cea46fa39 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.854682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0af94-5ed8-4527-a3ce-0f3cea46fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.854960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0af94-5ed8-4527-a3ce-0f3cea46fa39 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.855659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0af94-5ed8-4527-a3ce-0f3cea46fa39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:31.855968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0af94-5ed8-4527-a3ce-0f3cea46fa39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:31.881531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0af94-5ed8-4527-a3ce-0f3cea46fa39 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:31.895517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 415/828] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:31.901563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf2fb4-6058-433f-9240-6c0f18336e6b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.911844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf2fb4-6058-433f-9240-6c0f18336e6b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.917522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89403ed8-884c-432f-9168-255abb52438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.919504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89403ed8-884c-432f-9168-255abb52438f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.919801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89403ed8-884c-432f-9168-255abb52438f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.920082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89403ed8-884c-432f-9168-255abb52438f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.933159 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89403ed8-884c-432f-9168-255abb52438f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:31.959275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89403ed8-884c-432f-9168-255abb52438f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:31.975075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-89403ed8-884c-432f-9168-255abb52438f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:31.976264 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 414/829] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:31.982694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0af94-5ed8-4527-a3ce-0f3cea46fa39 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:31.992661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0af94-5ed8-4527-a3ce-0f3cea46fa39 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:31.997272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374d62f-4e14-42fb-9789-41236fb0fc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:31.997844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374d62f-4e14-42fb-9789-41236fb0fc7e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:31.998157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374d62f-4e14-42fb-9789-41236fb0fc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:31.998428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374d62f-4e14-42fb-9789-41236fb0fc7e admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:31.999168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374d62f-4e14-42fb-9789-41236fb0fc7e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:31.999459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374d62f-4e14-42fb-9789-41236fb0fc7e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:32.025221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374d62f-4e14-42fb-9789-41236fb0fc7e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:32.040973 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 416/830] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:32.050967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89403ed8-884c-432f-9168-255abb52438f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:32.067715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89403ed8-884c-432f-9168-255abb52438f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:32.073306 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a4525-de94-4549-be93-89d2190685f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:32.074175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4525-de94-4549-be93-89d2190685f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:32.074459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4525-de94-4549-be93-89d2190685f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:32.074736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4525-de94-4549-be93-89d2190685f3 admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/20905ef1afa847bc8f2f6f6e335f8bd2/roles/26d42daa051b453488fbaac4330bd6ab` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:32.096965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a4525-de94-4549-be93-89d2190685f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=20905ef1afa847bc8f2f6f6e335f8bd2, role_id=26d42daa051b453488fbaac4330bd6ab)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:32.123831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a4525-de94-4549-be93-89d2190685f3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:32.138891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 415/831] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:23:32 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/20905ef1afa847bc8f2f6f6e335f8bd2/roles/26d42daa051b453488fbaac4330bd6ab => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:23:34.097767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb770cfb-f03b-43bb-82a8-df80c709b695 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.098354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb770cfb-f03b-43bb-82a8-df80c709b695 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.098354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb770cfb-f03b-43bb-82a8-df80c709b695 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.100071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 417/832] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:34.106235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c6f40-96a8-4eeb-aa2e-81416ecd4dcf None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.106722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c6f40-96a8-4eeb-aa2e-81416ecd4dcf None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.106819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c6f40-96a8-4eeb-aa2e-81416ecd4dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.130522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-bb1c6f40-96a8-4eeb-aa2e-81416ecd4dcf None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:34.131704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-bb1c6f40-96a8-4eeb-aa2e-81416ecd4dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:34.198747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 416/833] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:34 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:34.221482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb770cfb-f03b-43bb-82a8-df80c709b695 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.234431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb770cfb-f03b-43bb-82a8-df80c709b695 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.238948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f600-7565-4426-9fc2-9700308df9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.239678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f600-7565-4426-9fc2-9700308df9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.239959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f600-7565-4426-9fc2-9700308df9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.240242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f600-7565-4426-9fc2-9700308df9d0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.252185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273f600-7565-4426-9fc2-9700308df9d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:23:34.258774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-2273f600-7565-4426-9fc2-9700308df9d0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:23:34.259875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 418/834] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:34.266223 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c6f40-96a8-4eeb-aa2e-81416ecd4dcf None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.276526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c6f40-96a8-4eeb-aa2e-81416ecd4dcf None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.280981 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52398325-a72a-4bc3-8c09-ddf6e8e9af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.281584 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398325-a72a-4bc3-8c09-ddf6e8e9af5d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.281889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398325-a72a-4bc3-8c09-ddf6e8e9af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.282189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398325-a72a-4bc3-8c09-ddf6e8e9af5d admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.282911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52398325-a72a-4bc3-8c09-ddf6e8e9af5d admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:34.283210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52398325-a72a-4bc3-8c09-ddf6e8e9af5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.309036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52398325-a72a-4bc3-8c09-ddf6e8e9af5d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.318223 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 417/835] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:34.324209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f600-7565-4426-9fc2-9700308df9d0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.336728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f600-7565-4426-9fc2-9700308df9d0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.342180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d53df6-2776-4a1d-95a8-a6b9684dc905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.342909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d53df6-2776-4a1d-95a8-a6b9684dc905 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.343185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d53df6-2776-4a1d-95a8-a6b9684dc905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.343454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d53df6-2776-4a1d-95a8-a6b9684dc905 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.356096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d53df6-2776-4a1d-95a8-a6b9684dc905 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.381849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d53df6-2776-4a1d-95a8-a6b9684dc905 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.403994 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-93d53df6-2776-4a1d-95a8-a6b9684dc905 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:34.405128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 419/836] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:34.411124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52398325-a72a-4bc3-8c09-ddf6e8e9af5d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.420949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52398325-a72a-4bc3-8c09-ddf6e8e9af5d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.425864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a1e90-dbf2-465b-8464-06badce3e57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.426615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a1e90-dbf2-465b-8464-06badce3e57d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.426901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a1e90-dbf2-465b-8464-06badce3e57d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.427185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a1e90-dbf2-465b-8464-06badce3e57d admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.427892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a1e90-dbf2-465b-8464-06badce3e57d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:34.428188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a1e90-dbf2-465b-8464-06badce3e57d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.453586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a1e90-dbf2-465b-8464-06badce3e57d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.466933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 418/837] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:34.472866 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d53df6-2776-4a1d-95a8-a6b9684dc905 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.482893 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d53df6-2776-4a1d-95a8-a6b9684dc905 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.488197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec5bd1-fa56-4bf5-a709-5db99131370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.489053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec5bd1-fa56-4bf5-a709-5db99131370b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.489339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec5bd1-fa56-4bf5-a709-5db99131370b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.489612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec5bd1-fa56-4bf5-a709-5db99131370b admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.503215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec5bd1-fa56-4bf5-a709-5db99131370b admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.528845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec5bd1-fa56-4bf5-a709-5db99131370b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.547962 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-3aec5bd1-fa56-4bf5-a709-5db99131370b admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 16 14:23:34.549119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 420/838] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/users/neutron => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:34.555707 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a1e90-dbf2-465b-8464-06badce3e57d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.565882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a1e90-dbf2-465b-8464-06badce3e57d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.571361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73426-13c6-494a-a596-e052c887bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.571975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73426-13c6-494a-a596-e052c887bc84 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.572263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73426-13c6-494a-a596-e052c887bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.572534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73426-13c6-494a-a596-e052c887bc84 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.573299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f73426-13c6-494a-a596-e052c887bc84 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:34.573616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f73426-13c6-494a-a596-e052c887bc84 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.599510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f73426-13c6-494a-a596-e052c887bc84 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.630652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 419/839] 10.222.0.67 () {56 vars in 1160 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:34.636551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec5bd1-fa56-4bf5-a709-5db99131370b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.647704 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec5bd1-fa56-4bf5-a709-5db99131370b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.652562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669cb5a-a389-4577-b551-c5bcb5cb1279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.653134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669cb5a-a389-4577-b551-c5bcb5cb1279 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.653421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669cb5a-a389-4577-b551-c5bcb5cb1279 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.653686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669cb5a-a389-4577-b551-c5bcb5cb1279 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.662422 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669cb5a-a389-4577-b551-c5bcb5cb1279 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.688593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669cb5a-a389-4577-b551-c5bcb5cb1279 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.699287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 421/840] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:34.705327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73426-13c6-494a-a596-e052c887bc84 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.715798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73426-13c6-494a-a596-e052c887bc84 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.721271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d2377-4027-4b55-985e-046c54206af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.722018 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d2377-4027-4b55-985e-046c54206af5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.722339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d2377-4027-4b55-985e-046c54206af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.722614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d2377-4027-4b55-985e-046c54206af5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.735098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d2377-4027-4b55-985e-046c54206af5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.760872 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d2377-4027-4b55-985e-046c54206af5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.780839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-483d2377-4027-4b55-985e-046c54206af5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:34.782020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 420/841] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:34.788122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669cb5a-a389-4577-b551-c5bcb5cb1279 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.797040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669cb5a-a389-4577-b551-c5bcb5cb1279 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.803474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3c346-befb-42e5-b72b-39732fc43e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.804122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3c346-befb-42e5-b72b-39732fc43e92 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.804403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3c346-befb-42e5-b72b-39732fc43e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.804711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3c346-befb-42e5-b72b-39732fc43e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.805456 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3c346-befb-42e5-b72b-39732fc43e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:34.805744 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3c346-befb-42e5-b72b-39732fc43e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.835305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3c346-befb-42e5-b72b-39732fc43e92 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.848687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 422/842] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:34.854550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d2377-4027-4b55-985e-046c54206af5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.864655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d2377-4027-4b55-985e-046c54206af5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.870415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06824de-d4ee-4a9d-976a-6cfc0092e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.871162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06824de-d4ee-4a9d-976a-6cfc0092e7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.871441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06824de-d4ee-4a9d-976a-6cfc0092e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.871713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06824de-d4ee-4a9d-976a-6cfc0092e7d8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.882942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06824de-d4ee-4a9d-976a-6cfc0092e7d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.908964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06824de-d4ee-4a9d-976a-6cfc0092e7d8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.925476 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-d06824de-d4ee-4a9d-976a-6cfc0092e7d8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:34.927059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 421/843] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:34.933373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3c346-befb-42e5-b72b-39732fc43e92 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:34.944216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3c346-befb-42e5-b72b-39732fc43e92 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:34.949777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ff3a-b2bf-455f-a112-53fdfa143378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:34.950463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ff3a-b2bf-455f-a112-53fdfa143378 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:34.950741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ff3a-b2bf-455f-a112-53fdfa143378 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:34.951009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ff3a-b2bf-455f-a112-53fdfa143378 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:34.951764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619ff3a-b2bf-455f-a112-53fdfa143378 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:34.952079 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619ff3a-b2bf-455f-a112-53fdfa143378 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:34.982025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619ff3a-b2bf-455f-a112-53fdfa143378 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:34.997702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 423/844] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:35.003717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06824de-d4ee-4a9d-976a-6cfc0092e7d8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:35.014365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06824de-d4ee-4a9d-976a-6cfc0092e7d8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:35.020110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebdcfe-43f9-4012-80c5-ca0809217c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:35.020919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebdcfe-43f9-4012-80c5-ca0809217c50 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:35.021408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebdcfe-43f9-4012-80c5-ca0809217c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:35.021828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebdcfe-43f9-4012-80c5-ca0809217c50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:35.022925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebdcfe-43f9-4012-80c5-ca0809217c50 admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=20905ef1afa847bc8f2f6f6e335f8bd2) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:35.023414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebdcfe-43f9-4012-80c5-ca0809217c50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:35.054129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebdcfe-43f9-4012-80c5-ca0809217c50 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:35.060868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 422/845] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:23:35 2021] GET /identity/v3/role_assignments?user.id=20905ef1afa847bc8f2f6f6e335f8bd2&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:37.062954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23747fce-bf1c-49f9-ae81-a5ffb87fdaae None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.063525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23747fce-bf1c-49f9-ae81-a5ffb87fdaae None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.063525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23747fce-bf1c-49f9-ae81-a5ffb87fdaae None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.065180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 424/846] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:37.071862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc121e6-6fac-4734-8208-7f14dd8efad7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.072373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc121e6-6fac-4734-8208-7f14dd8efad7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.072458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc121e6-6fac-4734-8208-7f14dd8efad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.099007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9fc121e6-6fac-4734-8208-7f14dd8efad7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:37.100177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9fc121e6-6fac-4734-8208-7f14dd8efad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:37.108408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 423/847] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:37 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:37.132995 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23747fce-bf1c-49f9-ae81-a5ffb87fdaae None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:37.146259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23747fce-bf1c-49f9-ae81-a5ffb87fdaae None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:37.150331 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b199744-2501-42ed-a2eb-b51950835840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:37.156519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b199744-2501-42ed-a2eb-b51950835840 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.156519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b199744-2501-42ed-a2eb-b51950835840 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.156519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b199744-2501-42ed-a2eb-b51950835840 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.156519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b199744-2501-42ed-a2eb-b51950835840 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:37.178791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b199744-2501-42ed-a2eb-b51950835840 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:37.190251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-0b199744-2501-42ed-a2eb-b51950835840 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 16 14:23:37.191926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 425/848] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:37 2021] GET /identity/v3/services/network => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:37.197798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc121e6-6fac-4734-8208-7f14dd8efad7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:37.206933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc121e6-6fac-4734-8208-7f14dd8efad7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:37.212367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44a9e6-2450-431f-9cca-4c5a22efbf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:37.212989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a9e6-2450-431f-9cca-4c5a22efbf66 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.213272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a9e6-2450-431f-9cca-4c5a22efbf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.213544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a9e6-2450-431f-9cca-4c5a22efbf66 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.214252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44a9e6-2450-431f-9cca-4c5a22efbf66 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:37.214551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44a9e6-2450-431f-9cca-4c5a22efbf66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:37.239907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44a9e6-2450-431f-9cca-4c5a22efbf66 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:37.245596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 424/849] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:23:37 2021] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:37.251751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b199744-2501-42ed-a2eb-b51950835840 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:37.262022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b199744-2501-42ed-a2eb-b51950835840 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:37.267866 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95f5fe-d962-4eec-a45f-cc7a8450c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:37.268623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95f5fe-d962-4eec-a45f-cc7a8450c089 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:37.269002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95f5fe-d962-4eec-a45f-cc7a8450c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:37.269282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95f5fe-d962-4eec-a45f-cc7a8450c089 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:37.270369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95f5fe-d962-4eec-a45f-cc7a8450c089 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:37.270791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95f5fe-d962-4eec-a45f-cc7a8450c089 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:37.296826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95f5fe-d962-4eec-a45f-cc7a8450c089 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:37.302585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 426/850] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:23:37 2021] GET /identity/v3/services?type=network => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:39.315943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3478a4d-bd91-4b16-ba38-63d4f670feef None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:39.316536 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3478a4d-bd91-4b16-ba38-63d4f670feef None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:39.317346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3478a4d-bd91-4b16-ba38-63d4f670feef None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:39.319206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 425/851] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:39.327614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacd37f-7147-4f14-93e6-276dfa120849 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:39.328191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacd37f-7147-4f14-93e6-276dfa120849 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:39.328191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacd37f-7147-4f14-93e6-276dfa120849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:39.353370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-ecacd37f-7147-4f14-93e6-276dfa120849 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:39.354639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ecacd37f-7147-4f14-93e6-276dfa120849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:39.363113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 427/852] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:39 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:39.386303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3478a4d-bd91-4b16-ba38-63d4f670feef None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:39.399842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3478a4d-bd91-4b16-ba38-63d4f670feef None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:39.404693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab651e-c0a2-49c2-a4db-ab92ee027ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:39.405329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab651e-c0a2-49c2-a4db-ab92ee027ede admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:39.405605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab651e-c0a2-49c2-a4db-ab92ee027ede admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:39.405882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab651e-c0a2-49c2-a4db-ab92ee027ede admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:39.406624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab651e-c0a2-49c2-a4db-ab92ee027ede admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:39.433205 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab651e-c0a2-49c2-a4db-ab92ee027ede admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:39.454888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 426/853] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:23:39 2021] POST /identity/v3/services => generated 240 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:41.451362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646281-d5f2-4c62-86d4-4cb2c99d6811 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.451879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646281-d5f2-4c62-86d4-4cb2c99d6811 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.451879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646281-d5f2-4c62-86d4-4cb2c99d6811 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.453568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 428/854] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:41.461312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa75c1a-8fa8-4e8a-827e-cf39b3946757 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.461908 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa75c1a-8fa8-4e8a-827e-cf39b3946757 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.461908 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa75c1a-8fa8-4e8a-827e-cf39b3946757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.488766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-caa75c1a-8fa8-4e8a-827e-cf39b3946757 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:41.489936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-caa75c1a-8fa8-4e8a-827e-cf39b3946757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:41.508273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 427/855] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:41 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:23:41.532989 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c646281-d5f2-4c62-86d4-4cb2c99d6811 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:41.547169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c646281-d5f2-4c62-86d4-4cb2c99d6811 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:41.552574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f8248-087f-42c0-99c6-578ee657afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:41.553296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f8248-087f-42c0-99c6-578ee657afc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.553575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f8248-087f-42c0-99c6-578ee657afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.553853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f8248-087f-42c0-99c6-578ee657afc9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.554531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f8248-087f-42c0-99c6-578ee657afc9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:41.580064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f8248-087f-42c0-99c6-578ee657afc9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:41.592044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-800f8248-087f-42c0-99c6-578ee657afc9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 16 14:23:41.593308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 429/856] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:41 2021] GET /identity/v3/services/network => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:41.602218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa75c1a-8fa8-4e8a-827e-cf39b3946757 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:41.611661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa75c1a-8fa8-4e8a-827e-cf39b3946757 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:41.617035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a9fa6-f535-429c-a6c2-803002b9960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:41.617660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a9fa6-f535-429c-a6c2-803002b9960d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.617926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a9fa6-f535-429c-a6c2-803002b9960d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.618250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a9fa6-f535-429c-a6c2-803002b9960d admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.618950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a9fa6-f535-429c-a6c2-803002b9960d admin admin] RBAC: Adding query filter params (name=network) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:41.619247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a9fa6-f535-429c-a6c2-803002b9960d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:41.646454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a9fa6-f535-429c-a6c2-803002b9960d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:41.652528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 428/857] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:23:41 2021] GET /identity/v3/services?name=network => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:41.658984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f8248-087f-42c0-99c6-578ee657afc9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:41.671267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f8248-087f-42c0-99c6-578ee657afc9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:41.677101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e4a59-ae66-47b3-9b2e-c209ba689458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:41.677720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e4a59-ae66-47b3-9b2e-c209ba689458 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.678022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e4a59-ae66-47b3-9b2e-c209ba689458 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.678300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e4a59-ae66-47b3-9b2e-c209ba689458 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.679007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e4a59-ae66-47b3-9b2e-c209ba689458 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:41.679297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e4a59-ae66-47b3-9b2e-c209ba689458 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:41.705685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e4a59-ae66-47b3-9b2e-c209ba689458 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:41.712051 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 430/858] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:23:41 2021] GET /identity/v3/services?type=network => generated 350 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:41.718942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a9fa6-f535-429c-a6c2-803002b9960d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:41.730209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a9fa6-f535-429c-a6c2-803002b9960d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:41.735373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47e82b-ad18-4376-9968-043b0e1a47dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:41.735974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47e82b-ad18-4376-9968-043b0e1a47dc admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.736256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47e82b-ad18-4376-9968-043b0e1a47dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.736532 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47e82b-ad18-4376-9968-043b0e1a47dc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.737282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47e82b-ad18-4376-9968-043b0e1a47dc admin admin] RBAC: Adding query filter params (interface=public, service_id=5f2f6377ada543ef9f55348f4204c651, region_id=RegionOne) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:41.737624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47e82b-ad18-4376-9968-043b0e1a47dc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:41.764077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47e82b-ad18-4376-9968-043b0e1a47dc admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:41.771087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 429/859] 10.222.0.67 () {56 vars in 1272 bytes} [Thu Dec 16 14:23:41 2021] GET /identity/v3/endpoints?service_id=5f2f6377ada543ef9f55348f4204c651&interface=public®ion_id=RegionOne => generated 194 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:41.777101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e4a59-ae66-47b3-9b2e-c209ba689458 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:41.787357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e4a59-ae66-47b3-9b2e-c209ba689458 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:41.792480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cad76-5481-4f12-8afa-dbaf779a5092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:41.793100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cad76-5481-4f12-8afa-dbaf779a5092 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:41.793379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cad76-5481-4f12-8afa-dbaf779a5092 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:41.793651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cad76-5481-4f12-8afa-dbaf779a5092 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:41.794347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cad76-5481-4f12-8afa-dbaf779a5092 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:41.819956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cad76-5481-4f12-8afa-dbaf779a5092 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:41.827073 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 431/860] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:23:41 2021] GET /identity/v3/services => generated 1967 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:23:43.835424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d99ed-8954-42b5-86f0-fc1fe9612c94 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.836391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d99ed-8954-42b5-86f0-fc1fe9612c94 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.836646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d99ed-8954-42b5-86f0-fc1fe9612c94 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.838526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 430/861] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:43.844761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97078927-a087-48e2-9178-f8a81456061f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.845332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97078927-a087-48e2-9178-f8a81456061f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.845332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97078927-a087-48e2-9178-f8a81456061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.870647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-97078927-a087-48e2-9178-f8a81456061f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:43.871825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-97078927-a087-48e2-9178-f8a81456061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:43.879915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 432/862] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:43 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:43.903017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d99ed-8954-42b5-86f0-fc1fe9612c94 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.917118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d99ed-8954-42b5-86f0-fc1fe9612c94 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.922150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce7cda-7972-42d2-ac6b-9a709bbf0d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.922919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce7cda-7972-42d2-ac6b-9a709bbf0d4a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.923205 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce7cda-7972-42d2-ac6b-9a709bbf0d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.923489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce7cda-7972-42d2-ac6b-9a709bbf0d4a admin admin] PATH_INFO: `/v3/services/network` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.924460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce7cda-7972-42d2-ac6b-9a709bbf0d4a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:43.950318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce7cda-7972-42d2-ac6b-9a709bbf0d4a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:43.963039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-a6ce7cda-7972-42d2-ac6b-9a709bbf0d4a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 16 14:23:43.964236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 431/863] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/services/network => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:43.971153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97078927-a087-48e2-9178-f8a81456061f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:43.984089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97078927-a087-48e2-9178-f8a81456061f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:43.991022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dd0c7-6ece-4c31-b76d-03dd1f850e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:43.991596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dd0c7-6ece-4c31-b76d-03dd1f850e34 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:43.991876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dd0c7-6ece-4c31-b76d-03dd1f850e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:43.992151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dd0c7-6ece-4c31-b76d-03dd1f850e34 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:43.992862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dd0c7-6ece-4c31-b76d-03dd1f850e34 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:43.993158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dd0c7-6ece-4c31-b76d-03dd1f850e34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:44.019059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dd0c7-6ece-4c31-b76d-03dd1f850e34 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:44.024832 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 433/864] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:23:43 2021] GET /identity/v3/services?name=network => generated 124 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:44.031223 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce7cda-7972-42d2-ac6b-9a709bbf0d4a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:44.041566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce7cda-7972-42d2-ac6b-9a709bbf0d4a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:44.046623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d426d-0a5a-43b1-8d92-c550b4ba3bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:44.047230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d426d-0a5a-43b1-8d92-c550b4ba3bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:44.047518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d426d-0a5a-43b1-8d92-c550b4ba3bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:44.047802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d426d-0a5a-43b1-8d92-c550b4ba3bb2 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:44.048482 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d426d-0a5a-43b1-8d92-c550b4ba3bb2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:44.049109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d426d-0a5a-43b1-8d92-c550b4ba3bb2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:44.074741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d426d-0a5a-43b1-8d92-c550b4ba3bb2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:44.080313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 432/865] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Dec 16 14:23:44 2021] GET /identity/v3/services?type=network => generated 350 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:44.086682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dd0c7-6ece-4c31-b76d-03dd1f850e34 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:44.096793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dd0c7-6ece-4c31-b76d-03dd1f850e34 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:44.102335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f19d2-f2d6-4824-89f0-029711701320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:44.102959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f19d2-f2d6-4824-89f0-029711701320 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:44.103237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f19d2-f2d6-4824-89f0-029711701320 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:44.103492 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f19d2-f2d6-4824-89f0-029711701320 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:44.104186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f19d2-f2d6-4824-89f0-029711701320 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:44.129526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f19d2-f2d6-4824-89f0-029711701320 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:44.151005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 434/866] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:23:44 2021] POST /identity/v3/endpoints => generated 327 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:23:46.179603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbca49e-7121-41a8-813a-5f35b227ca71 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.180250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbca49e-7121-41a8-813a-5f35b227ca71 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.180250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbca49e-7121-41a8-813a-5f35b227ca71 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.181879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 433/867] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:46.187857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d61a79-2d96-4368-9712-205e48b9d2e0 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.188441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d61a79-2d96-4368-9712-205e48b9d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.188441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d61a79-2d96-4368-9712-205e48b9d2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.213403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-83d61a79-2d96-4368-9712-205e48b9d2e0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:46.214641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-83d61a79-2d96-4368-9712-205e48b9d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:46.235971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 435/868] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:46 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:46.259471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbca49e-7121-41a8-813a-5f35b227ca71 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.273275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbca49e-7121-41a8-813a-5f35b227ca71 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.278720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.279330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.279613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.279894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.280592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:46.306572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.313840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.sql.core [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 16 14:23:46.313840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 16 14:23:46.313840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [parameters: {'id': '075fc21ad1db471c97f501d3b75f8719', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 16 14:23:46.313840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66112) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Dec 16 14:23:46.320159 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 16 14:23:46.321370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 434/869] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:23:46 2021] POST /identity/v3/roles => generated 144 bytes in 62 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:46.327768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d61a79-2d96-4368-9712-205e48b9d2e0 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.337571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d61a79-2d96-4368-9712-205e48b9d2e0 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.342031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c44a3-679e-4ecb-a518-f166ca8c4093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.342817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c44a3-679e-4ecb-a518-f166ca8c4093 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.343097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c44a3-679e-4ecb-a518-f166ca8c4093 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.343374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c44a3-679e-4ecb-a518-f166ca8c4093 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.355952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c44a3-679e-4ecb-a518-f166ca8c4093 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:23:46.363056 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-169c44a3-679e-4ecb-a518-f166ca8c4093 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 16 14:23:46.364203 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 436/870] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:46.370570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:46.380775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c9144-d7ca-4806-8fff-35824488181f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:46.385327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680b59a-c293-492f-9ed3-081815fe44b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:46.385926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680b59a-c293-492f-9ed3-081815fe44b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:46.386300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680b59a-c293-492f-9ed3-081815fe44b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:46.386525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680b59a-c293-492f-9ed3-081815fe44b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:46.387233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680b59a-c293-492f-9ed3-081815fe44b3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:46.387527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680b59a-c293-492f-9ed3-081815fe44b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:46.413539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680b59a-c293-492f-9ed3-081815fe44b3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:46.422690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 435/871] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:48.427130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60428c5-3ecf-4fa8-a562-44715a90e8b0 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.427649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60428c5-3ecf-4fa8-a562-44715a90e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.427649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60428c5-3ecf-4fa8-a562-44715a90e8b0 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.430151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 437/872] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:48.439118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0b23e-9d56-43ed-bfbe-468aec2199ac None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.439556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0b23e-9d56-43ed-bfbe-468aec2199ac None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.439699 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0b23e-9d56-43ed-bfbe-468aec2199ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.463626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-26a0b23e-9d56-43ed-bfbe-468aec2199ac None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:48.464766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-26a0b23e-9d56-43ed-bfbe-468aec2199ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:48.472756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 436/873] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:48.497078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60428c5-3ecf-4fa8-a562-44715a90e8b0 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.512328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60428c5-3ecf-4fa8-a562-44715a90e8b0 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.518461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44980-7ec1-447f-8eef-e301c44038de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.519194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44980-7ec1-447f-8eef-e301c44038de admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.519454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44980-7ec1-447f-8eef-e301c44038de admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.519758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44980-7ec1-447f-8eef-e301c44038de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.531838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab44980-7ec1-447f-8eef-e301c44038de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:48.557840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab44980-7ec1-447f-8eef-e301c44038de admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:48.576553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-1ab44980-7ec1-447f-8eef-e301c44038de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:48.577687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 438/874] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:48.584749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0b23e-9d56-43ed-bfbe-468aec2199ac None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.594798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0b23e-9d56-43ed-bfbe-468aec2199ac None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.600930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8607f-81f4-4778-b667-948ebaf573d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.601537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8607f-81f4-4778-b667-948ebaf573d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.601817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8607f-81f4-4778-b667-948ebaf573d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.602125 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8607f-81f4-4778-b667-948ebaf573d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.602849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8607f-81f4-4778-b667-948ebaf573d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:48.603147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8607f-81f4-4778-b667-948ebaf573d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:48.629009 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8607f-81f4-4778-b667-948ebaf573d5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:48.643336 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 437/875] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:48.649590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44980-7ec1-447f-8eef-e301c44038de admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:48.662993 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44980-7ec1-447f-8eef-e301c44038de admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:48.670575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8d422-f89f-43b4-93d6-1b32b889f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:48.671518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d422-f89f-43b4-93d6-1b32b889f7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:48.671984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d422-f89f-43b4-93d6-1b32b889f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:48.672434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d422-f89f-43b4-93d6-1b32b889f7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:48.673902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8d422-f89f-43b4-93d6-1b32b889f7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:48.700211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8d422-f89f-43b4-93d6-1b32b889f7b2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:48.722158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 439/876] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:23:48 2021] POST /identity/v3/users => generated 247 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:23:50.753049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d5a23-f3e8-4c28-a159-786f9e2c379e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:50.753646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d5a23-f3e8-4c28-a159-786f9e2c379e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:50.753646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d5a23-f3e8-4c28-a159-786f9e2c379e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:50.755363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 438/877] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:50.760689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419367b-7159-4fee-a0a2-8658c583e2b5 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:50.761117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419367b-7159-4fee-a0a2-8658c583e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:50.761251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419367b-7159-4fee-a0a2-8658c583e2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:50.785460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5419367b-7159-4fee-a0a2-8658c583e2b5 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:50.786668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5419367b-7159-4fee-a0a2-8658c583e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:50.795018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 440/878] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:50.818460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d5a23-f3e8-4c28-a159-786f9e2c379e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:50.831775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d5a23-f3e8-4c28-a159-786f9e2c379e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:50.836219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178bca1-32e5-4785-bbac-fe55b012a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:50.836981 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178bca1-32e5-4785-bbac-fe55b012a51a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:50.837260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178bca1-32e5-4785-bbac-fe55b012a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:50.837533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178bca1-32e5-4785-bbac-fe55b012a51a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:50.850229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178bca1-32e5-4785-bbac-fe55b012a51a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:23:50.856939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-9178bca1-32e5-4785-bbac-fe55b012a51a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:23:50.858069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 439/879] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:50.864627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419367b-7159-4fee-a0a2-8658c583e2b5 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:50.873948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419367b-7159-4fee-a0a2-8658c583e2b5 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:50.878705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585f0c-be75-4b82-bcb0-2b72d0a79982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:50.879298 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585f0c-be75-4b82-bcb0-2b72d0a79982 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:50.879579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585f0c-be75-4b82-bcb0-2b72d0a79982 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:50.879859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585f0c-be75-4b82-bcb0-2b72d0a79982 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:50.880585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1585f0c-be75-4b82-bcb0-2b72d0a79982 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:50.880883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1585f0c-be75-4b82-bcb0-2b72d0a79982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:50.906162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1585f0c-be75-4b82-bcb0-2b72d0a79982 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:50.915461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 441/880] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:23:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:50.921500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178bca1-32e5-4785-bbac-fe55b012a51a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:50.932328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178bca1-32e5-4785-bbac-fe55b012a51a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:50.937188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dc1a8-9105-498f-b4a8-6102266dda26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:50.938013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc1a8-9105-498f-b4a8-6102266dda26 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:50.938297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc1a8-9105-498f-b4a8-6102266dda26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:50.938571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc1a8-9105-498f-b4a8-6102266dda26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:50.950971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dc1a8-9105-498f-b4a8-6102266dda26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:50.976660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dc1a8-9105-498f-b4a8-6102266dda26 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.001061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-191dc1a8-9105-498f-b4a8-6102266dda26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:51.002311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 440/881] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:51.009010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585f0c-be75-4b82-bcb0-2b72d0a79982 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.019279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585f0c-be75-4b82-bcb0-2b72d0a79982 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.024819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a9bb-d52a-475d-9e8f-7c5f59afe541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.025413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a9bb-d52a-475d-9e8f-7c5f59afe541 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.025689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a9bb-d52a-475d-9e8f-7c5f59afe541 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.025962 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1a9bb-d52a-475d-9e8f-7c5f59afe541 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.026680 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1a9bb-d52a-475d-9e8f-7c5f59afe541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:51.026974 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1a9bb-d52a-475d-9e8f-7c5f59afe541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:51.053017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1a9bb-d52a-475d-9e8f-7c5f59afe541 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.068162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 442/882] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.074390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dc1a8-9105-498f-b4a8-6102266dda26 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.085499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dc1a8-9105-498f-b4a8-6102266dda26 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.091319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb189f-fcd0-49d5-87a3-0b94ce4faaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.092075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb189f-fcd0-49d5-87a3-0b94ce4faaca admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.092346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb189f-fcd0-49d5-87a3-0b94ce4faaca admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.092632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb189f-fcd0-49d5-87a3-0b94ce4faaca admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.107962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb189f-fcd0-49d5-87a3-0b94ce4faaca admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:51.137466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb189f-fcd0-49d5-87a3-0b94ce4faaca admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.157807 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-0aeb189f-fcd0-49d5-87a3-0b94ce4faaca admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:23:51.159564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 441/883] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/users/swift => generated 83 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:51.166411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a9bb-d52a-475d-9e8f-7c5f59afe541 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.179667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1a9bb-d52a-475d-9e8f-7c5f59afe541 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.184629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381fec6-2744-4d94-8fa9-950644a7dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.185232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381fec6-2744-4d94-8fa9-950644a7dc32 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.185507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381fec6-2744-4d94-8fa9-950644a7dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.185778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381fec6-2744-4d94-8fa9-950644a7dc32 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.186616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381fec6-2744-4d94-8fa9-950644a7dc32 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:51.186907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381fec6-2744-4d94-8fa9-950644a7dc32 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:51.212457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381fec6-2744-4d94-8fa9-950644a7dc32 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.243914 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 443/884] 10.222.0.67 () {56 vars in 1156 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.250204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb189f-fcd0-49d5-87a3-0b94ce4faaca admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.259905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb189f-fcd0-49d5-87a3-0b94ce4faaca admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.264161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdbd09-af9e-48b0-89d4-2e6dea392fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.264767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdbd09-af9e-48b0-89d4-2e6dea392fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.265049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdbd09-af9e-48b0-89d4-2e6dea392fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.265325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdbd09-af9e-48b0-89d4-2e6dea392fb2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.273082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdbd09-af9e-48b0-89d4-2e6dea392fb2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:51.299129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdbd09-af9e-48b0-89d4-2e6dea392fb2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.310035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 442/885] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:51.316371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381fec6-2744-4d94-8fa9-950644a7dc32 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.326820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381fec6-2744-4d94-8fa9-950644a7dc32 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.332167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703d2f8-4732-44c6-9cd1-c4c4725a79ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.332889 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703d2f8-4732-44c6-9cd1-c4c4725a79ca admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.333168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703d2f8-4732-44c6-9cd1-c4c4725a79ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.333438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703d2f8-4732-44c6-9cd1-c4c4725a79ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.345869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703d2f8-4732-44c6-9cd1-c4c4725a79ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:51.371916 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703d2f8-4732-44c6-9cd1-c4c4725a79ca admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.395589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-6703d2f8-4732-44c6-9cd1-c4c4725a79ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:51.396856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 444/886] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:51.405349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdbd09-af9e-48b0-89d4-2e6dea392fb2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.414830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdbd09-af9e-48b0-89d4-2e6dea392fb2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.419208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbcdb4-dc3e-47e2-823b-f2651765fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.419791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbcdb4-dc3e-47e2-823b-f2651765fc45 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.420067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbcdb4-dc3e-47e2-823b-f2651765fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.420344 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbcdb4-dc3e-47e2-823b-f2651765fc45 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.421017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbcdb4-dc3e-47e2-823b-f2651765fc45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:51.421283 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbcdb4-dc3e-47e2-823b-f2651765fc45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:51.448123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbcdb4-dc3e-47e2-823b-f2651765fc45 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.462375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 443/887] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.468504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703d2f8-4732-44c6-9cd1-c4c4725a79ca admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.485105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703d2f8-4732-44c6-9cd1-c4c4725a79ca admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.494277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee8f4-5982-4c18-ba3a-084f835c72da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.495433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee8f4-5982-4c18-ba3a-084f835c72da admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.495900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee8f4-5982-4c18-ba3a-084f835c72da admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.496328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee8f4-5982-4c18-ba3a-084f835c72da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.508943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ee8f4-5982-4c18-ba3a-084f835c72da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:51.535583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ee8f4-5982-4c18-ba3a-084f835c72da admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.550867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-401ee8f4-5982-4c18-ba3a-084f835c72da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:51.552007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 445/888] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:51.558282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbcdb4-dc3e-47e2-823b-f2651765fc45 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.571148 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbcdb4-dc3e-47e2-823b-f2651765fc45 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.576010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ae9ce-d85c-4a93-acf3-10c8444e843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.576617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae9ce-d85c-4a93-acf3-10c8444e843c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.576906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae9ce-d85c-4a93-acf3-10c8444e843c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.577155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae9ce-d85c-4a93-acf3-10c8444e843c admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.577934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ae9ce-d85c-4a93-acf3-10c8444e843c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:51.578236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ae9ce-d85c-4a93-acf3-10c8444e843c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:51.608267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ae9ce-d85c-4a93-acf3-10c8444e843c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.622923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 444/889] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:51.629643 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee8f4-5982-4c18-ba3a-084f835c72da admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:51.639856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee8f4-5982-4c18-ba3a-084f835c72da admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:51.645170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700a255-9b47-4bb9-8d06-1c58dfc3e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:51.645777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700a255-9b47-4bb9-8d06-1c58dfc3e9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:51.646058 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700a255-9b47-4bb9-8d06-1c58dfc3e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:51.646366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700a255-9b47-4bb9-8d06-1c58dfc3e9d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:51.647149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700a255-9b47-4bb9-8d06-1c58dfc3e9d7 admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f757256b0c684c61a90421d1aec1d31d) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:51.647506 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700a255-9b47-4bb9-8d06-1c58dfc3e9d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:51.673564 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700a255-9b47-4bb9-8d06-1c58dfc3e9d7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:51.680136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 446/890] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:23:51 2021] GET /identity/v3/role_assignments?user.id=f757256b0c684c61a90421d1aec1d31d&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:53.660895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b92da2-f613-4f82-833e-11430d5d45f1 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.661471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b92da2-f613-4f82-833e-11430d5d45f1 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.661471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b92da2-f613-4f82-833e-11430d5d45f1 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.663197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 445/891] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:53.668670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943f44d-45ac-48e0-a512-11887081d807 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.669133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943f44d-45ac-48e0-a512-11887081d807 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.669231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943f44d-45ac-48e0-a512-11887081d807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.694019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-9943f44d-45ac-48e0-a512-11887081d807 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:53.695245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9943f44d-45ac-48e0-a512-11887081d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:53.702709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 447/892] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:53.725755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b92da2-f613-4f82-833e-11430d5d45f1 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:53.739650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b92da2-f613-4f82-833e-11430d5d45f1 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:53.744260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce97d7-90f8-4813-a4ba-1a288e0c1faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:53.744990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce97d7-90f8-4813-a4ba-1a288e0c1faf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.745278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce97d7-90f8-4813-a4ba-1a288e0c1faf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.745558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce97d7-90f8-4813-a4ba-1a288e0c1faf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.757709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce97d7-90f8-4813-a4ba-1a288e0c1faf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:23:53.764247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-e9ce97d7-90f8-4813-a4ba-1a288e0c1faf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:23:53.765376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 446/893] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:53.771774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943f44d-45ac-48e0-a512-11887081d807 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:53.781017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943f44d-45ac-48e0-a512-11887081d807 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:53.787088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345940-9c29-4d49-bb94-391714357cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:53.787684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345940-9c29-4d49-bb94-391714357cfc admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.787967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345940-9c29-4d49-bb94-391714357cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.788238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345940-9c29-4d49-bb94-391714357cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.788977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345940-9c29-4d49-bb94-391714357cfc admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:53.789271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345940-9c29-4d49-bb94-391714357cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:53.815123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345940-9c29-4d49-bb94-391714357cfc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:53.824758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 448/894] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:23:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:53.831333 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce97d7-90f8-4813-a4ba-1a288e0c1faf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:53.842694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce97d7-90f8-4813-a4ba-1a288e0c1faf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:53.848410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cdf9a-cb66-4dca-93b1-c9fd3e801b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:53.849147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cdf9a-cb66-4dca-93b1-c9fd3e801b26 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.849430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cdf9a-cb66-4dca-93b1-c9fd3e801b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.849703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cdf9a-cb66-4dca-93b1-c9fd3e801b26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.862155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cdf9a-cb66-4dca-93b1-c9fd3e801b26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:53.887732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cdf9a-cb66-4dca-93b1-c9fd3e801b26 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:53.907882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-1e5cdf9a-cb66-4dca-93b1-c9fd3e801b26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:53.909037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 447/895] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:53.915519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345940-9c29-4d49-bb94-391714357cfc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:53.925743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345940-9c29-4d49-bb94-391714357cfc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:53.930279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd9c81-1600-4c4b-8eea-f4c7bca428e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:53.930885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9c81-1600-4c4b-8eea-f4c7bca428e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.931164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9c81-1600-4c4b-8eea-f4c7bca428e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.931473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9c81-1600-4c4b-8eea-f4c7bca428e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:53.932136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd9c81-1600-4c4b-8eea-f4c7bca428e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:53.932439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd9c81-1600-4c4b-8eea-f4c7bca428e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:53.958539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd9c81-1600-4c4b-8eea-f4c7bca428e9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:53.972519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 449/896] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:53.979003 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cdf9a-cb66-4dca-93b1-c9fd3e801b26 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:53.989796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cdf9a-cb66-4dca-93b1-c9fd3e801b26 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:53.995128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81843e7b-5731-4b75-a6c8-f41a23654b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:53.995874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81843e7b-5731-4b75-a6c8-f41a23654b2a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:53.996163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81843e7b-5731-4b75-a6c8-f41a23654b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:53.996417 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81843e7b-5731-4b75-a6c8-f41a23654b2a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.009927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81843e7b-5731-4b75-a6c8-f41a23654b2a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:54.036066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81843e7b-5731-4b75-a6c8-f41a23654b2a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.056137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-81843e7b-5731-4b75-a6c8-f41a23654b2a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:23:54.057347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 448/897] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:53 2021] GET /identity/v3/users/swift => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:54.063585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd9c81-1600-4c4b-8eea-f4c7bca428e9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.073480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd9c81-1600-4c4b-8eea-f4c7bca428e9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.078537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b48a-6865-470a-87fb-1d377a99366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.079141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b48a-6865-470a-87fb-1d377a99366c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.079423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b48a-6865-470a-87fb-1d377a99366c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.079736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b48a-6865-470a-87fb-1d377a99366c admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.080734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56b48a-6865-470a-87fb-1d377a99366c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:54.081050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56b48a-6865-470a-87fb-1d377a99366c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:54.107122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56b48a-6865-470a-87fb-1d377a99366c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.138416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 450/898] 10.222.0.67 () {56 vars in 1156 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:54.145018 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81843e7b-5731-4b75-a6c8-f41a23654b2a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.154683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81843e7b-5731-4b75-a6c8-f41a23654b2a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.158957 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe4733-fb4f-430e-a140-9f890847954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.159678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe4733-fb4f-430e-a140-9f890847954d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.159962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe4733-fb4f-430e-a140-9f890847954d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.160242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe4733-fb4f-430e-a140-9f890847954d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.173849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe4733-fb4f-430e-a140-9f890847954d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:54.199855 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe4733-fb4f-430e-a140-9f890847954d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.218601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-79fe4733-fb4f-430e-a140-9f890847954d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:54.219767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 449/899] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:54.226177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b48a-6865-470a-87fb-1d377a99366c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.236032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b48a-6865-470a-87fb-1d377a99366c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.241093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997ca16-ed7f-4423-8e5f-275ca38ad546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.241689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997ca16-ed7f-4423-8e5f-275ca38ad546 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.241978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997ca16-ed7f-4423-8e5f-275ca38ad546 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.242285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997ca16-ed7f-4423-8e5f-275ca38ad546 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.242976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997ca16-ed7f-4423-8e5f-275ca38ad546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:54.243279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997ca16-ed7f-4423-8e5f-275ca38ad546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:54.269047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997ca16-ed7f-4423-8e5f-275ca38ad546 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.283754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 451/900] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:54.290622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe4733-fb4f-430e-a140-9f890847954d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.301178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe4733-fb4f-430e-a140-9f890847954d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.305496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74613f-dbcb-4996-8fee-d3beae6ac4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.306272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74613f-dbcb-4996-8fee-d3beae6ac4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.306558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74613f-dbcb-4996-8fee-d3beae6ac4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.306839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74613f-dbcb-4996-8fee-d3beae6ac4b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.316679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74613f-dbcb-4996-8fee-d3beae6ac4b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:54.342577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74613f-dbcb-4996-8fee-d3beae6ac4b4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.358637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-8c74613f-dbcb-4996-8fee-d3beae6ac4b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:54.359827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 450/901] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:54.366370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997ca16-ed7f-4423-8e5f-275ca38ad546 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.376965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997ca16-ed7f-4423-8e5f-275ca38ad546 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.381394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe72d6a-1d4e-4fc8-a601-6ccb8f97143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.382002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe72d6a-1d4e-4fc8-a601-6ccb8f97143d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.382307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe72d6a-1d4e-4fc8-a601-6ccb8f97143d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.382589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe72d6a-1d4e-4fc8-a601-6ccb8f97143d admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.383374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe72d6a-1d4e-4fc8-a601-6ccb8f97143d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:54.383677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe72d6a-1d4e-4fc8-a601-6ccb8f97143d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:54.409845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe72d6a-1d4e-4fc8-a601-6ccb8f97143d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.424489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 452/902] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:23:54.433226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74613f-dbcb-4996-8fee-d3beae6ac4b4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:54.445443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74613f-dbcb-4996-8fee-d3beae6ac4b4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:54.450291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b2e09-c1bd-4d9a-a349-c07a43aa0a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:54.451123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b2e09-c1bd-4d9a-a349-c07a43aa0a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:54.451399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b2e09-c1bd-4d9a-a349-c07a43aa0a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:54.451670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b2e09-c1bd-4d9a-a349-c07a43aa0a15 admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f757256b0c684c61a90421d1aec1d31d/roles/26d42daa051b453488fbaac4330bd6ab` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:54.473653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b2e09-c1bd-4d9a-a349-c07a43aa0a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=f757256b0c684c61a90421d1aec1d31d, role_id=26d42daa051b453488fbaac4330bd6ab)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:54.500341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b2e09-c1bd-4d9a-a349-c07a43aa0a15 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:54.517790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 451/903] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:23:54 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f757256b0c684c61a90421d1aec1d31d/roles/26d42daa051b453488fbaac4330bd6ab => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:23:56.486074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e92e41-76b2-4c25-a63a-ce4de392748a None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.486721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e92e41-76b2-4c25-a63a-ce4de392748a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.486721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e92e41-76b2-4c25-a63a-ce4de392748a None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.488205 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 453/904] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:56.493775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a3f9b-567b-432e-a1e4-05aa80fd1785 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.494202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a3f9b-567b-432e-a1e4-05aa80fd1785 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.494390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a3f9b-567b-432e-a1e4-05aa80fd1785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.517958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-921a3f9b-567b-432e-a1e4-05aa80fd1785 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:56.519148 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-921a3f9b-567b-432e-a1e4-05aa80fd1785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:56.585871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 452/905] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:23:56.609220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e92e41-76b2-4c25-a63a-ce4de392748a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.622151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e92e41-76b2-4c25-a63a-ce4de392748a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.626672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ae30-26b6-4fa7-a35f-f4d22dc55d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.627515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ae30-26b6-4fa7-a35f-f4d22dc55d22 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.627798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ae30-26b6-4fa7-a35f-f4d22dc55d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.628073 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ae30-26b6-4fa7-a35f-f4d22dc55d22 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.640088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10ae30-26b6-4fa7-a35f-f4d22dc55d22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:23:56.646697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-cb10ae30-26b6-4fa7-a35f-f4d22dc55d22 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:23:56.647814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 454/906] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:56.654367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a3f9b-567b-432e-a1e4-05aa80fd1785 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.663456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a3f9b-567b-432e-a1e4-05aa80fd1785 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.668096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c257fd8-b28e-40a3-a301-59ea9fa5937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.668691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c257fd8-b28e-40a3-a301-59ea9fa5937c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.668977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c257fd8-b28e-40a3-a301-59ea9fa5937c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.669255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c257fd8-b28e-40a3-a301-59ea9fa5937c admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.669971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c257fd8-b28e-40a3-a301-59ea9fa5937c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:56.670301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c257fd8-b28e-40a3-a301-59ea9fa5937c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:56.696070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c257fd8-b28e-40a3-a301-59ea9fa5937c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:56.705391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 453/907] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:56.711455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ae30-26b6-4fa7-a35f-f4d22dc55d22 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.721909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ae30-26b6-4fa7-a35f-f4d22dc55d22 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.727291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a67e2-8031-4935-b062-8cee2ec455a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.728003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a67e2-8031-4935-b062-8cee2ec455a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.728280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a67e2-8031-4935-b062-8cee2ec455a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.728548 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a67e2-8031-4935-b062-8cee2ec455a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.740577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a67e2-8031-4935-b062-8cee2ec455a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:56.768115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a67e2-8031-4935-b062-8cee2ec455a9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:56.789651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-f82a67e2-8031-4935-b062-8cee2ec455a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:56.790838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 455/908] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:56.796958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c257fd8-b28e-40a3-a301-59ea9fa5937c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.808146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c257fd8-b28e-40a3-a301-59ea9fa5937c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.813658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92d0be-20cc-4894-97b8-f5ab98ae6da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.814341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92d0be-20cc-4894-97b8-f5ab98ae6da4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.814624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92d0be-20cc-4894-97b8-f5ab98ae6da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.814897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92d0be-20cc-4894-97b8-f5ab98ae6da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.815583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92d0be-20cc-4894-97b8-f5ab98ae6da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:56.815885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92d0be-20cc-4894-97b8-f5ab98ae6da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:56.841140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92d0be-20cc-4894-97b8-f5ab98ae6da4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:56.855660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 454/909] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:56.862082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a67e2-8031-4935-b062-8cee2ec455a9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:56.872522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a67e2-8031-4935-b062-8cee2ec455a9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:56.877804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7371-5ed8-46bb-83b6-1fbb2cc4413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:56.878578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7371-5ed8-46bb-83b6-1fbb2cc4413c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:56.878865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7371-5ed8-46bb-83b6-1fbb2cc4413c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:56.879140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7371-5ed8-46bb-83b6-1fbb2cc4413c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:56.976693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df7371-5ed8-46bb-83b6-1fbb2cc4413c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:57.002658 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df7371-5ed8-46bb-83b6-1fbb2cc4413c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.022888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-c0df7371-5ed8-46bb-83b6-1fbb2cc4413c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:23:57.024130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 456/910] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:56 2021] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:57.030473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92d0be-20cc-4894-97b8-f5ab98ae6da4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.041075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92d0be-20cc-4894-97b8-f5ab98ae6da4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.046654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a137a1-7b43-42ad-a607-45adb4d7e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.047599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a137a1-7b43-42ad-a607-45adb4d7e5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.047884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a137a1-7b43-42ad-a607-45adb4d7e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.048241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a137a1-7b43-42ad-a607-45adb4d7e5f7 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.049058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a137a1-7b43-42ad-a607-45adb4d7e5f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:57.049366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a137a1-7b43-42ad-a607-45adb4d7e5f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:57.075304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a137a1-7b43-42ad-a607-45adb4d7e5f7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.108409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 455/911] 10.222.0.67 () {56 vars in 1156 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:57.114687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7371-5ed8-46bb-83b6-1fbb2cc4413c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.124837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7371-5ed8-46bb-83b6-1fbb2cc4413c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.129881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84fca-48d1-4d99-a3a7-66483b60052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.130530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84fca-48d1-4d99-a3a7-66483b60052b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.130801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84fca-48d1-4d99-a3a7-66483b60052b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.131082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84fca-48d1-4d99-a3a7-66483b60052b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.140250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e84fca-48d1-4d99-a3a7-66483b60052b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:57.166286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e84fca-48d1-4d99-a3a7-66483b60052b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.176322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 457/912] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:23:57.183056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a137a1-7b43-42ad-a607-45adb4d7e5f7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.198892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a137a1-7b43-42ad-a607-45adb4d7e5f7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.206651 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d26be-4541-48e6-b04f-dd784f3d01fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.207393 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d26be-4541-48e6-b04f-dd784f3d01fd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.207676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d26be-4541-48e6-b04f-dd784f3d01fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.207971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d26be-4541-48e6-b04f-dd784f3d01fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.221109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d26be-4541-48e6-b04f-dd784f3d01fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:57.246926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d26be-4541-48e6-b04f-dd784f3d01fd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.265138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-683d26be-4541-48e6-b04f-dd784f3d01fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:57.266255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 456/913] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:23:57.272414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84fca-48d1-4d99-a3a7-66483b60052b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.282848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84fca-48d1-4d99-a3a7-66483b60052b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.287542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc10e-a429-45ec-ac1f-9ac2b81369fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.288140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc10e-a429-45ec-ac1f-9ac2b81369fd admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.288437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc10e-a429-45ec-ac1f-9ac2b81369fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.288712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc10e-a429-45ec-ac1f-9ac2b81369fd admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.289438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc10e-a429-45ec-ac1f-9ac2b81369fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:57.289735 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc10e-a429-45ec-ac1f-9ac2b81369fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:57.315383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc10e-a429-45ec-ac1f-9ac2b81369fd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.329324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 458/914] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:57.335341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d26be-4541-48e6-b04f-dd784f3d01fd admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.350221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d26be-4541-48e6-b04f-dd784f3d01fd admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.355332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf073a5-c9ee-425f-bf28-61a5ac2179c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.356062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf073a5-c9ee-425f-bf28-61a5ac2179c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.356341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf073a5-c9ee-425f-bf28-61a5ac2179c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.356617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf073a5-c9ee-425f-bf28-61a5ac2179c1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.368447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf073a5-c9ee-425f-bf28-61a5ac2179c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:57.394050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf073a5-c9ee-425f-bf28-61a5ac2179c1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.408844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-baf073a5-c9ee-425f-bf28-61a5ac2179c1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:23:57.410030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 457/915] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:57.416253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc10e-a429-45ec-ac1f-9ac2b81369fd admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.427010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc10e-a429-45ec-ac1f-9ac2b81369fd admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.432493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0624f6-6d45-4de5-ae63-898ebffa5d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.433092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0624f6-6d45-4de5-ae63-898ebffa5d15 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.433357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0624f6-6d45-4de5-ae63-898ebffa5d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.433646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0624f6-6d45-4de5-ae63-898ebffa5d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.434444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0624f6-6d45-4de5-ae63-898ebffa5d15 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:57.434743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0624f6-6d45-4de5-ae63-898ebffa5d15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:57.460154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0624f6-6d45-4de5-ae63-898ebffa5d15 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.474159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 459/916] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:57.480538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf073a5-c9ee-425f-bf28-61a5ac2179c1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:57.490486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf073a5-c9ee-425f-bf28-61a5ac2179c1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:57.495533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c8c43-87fd-4c4b-91e8-2311427dda45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:57.496243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c8c43-87fd-4c4b-91e8-2311427dda45 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:57.496372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c8c43-87fd-4c4b-91e8-2311427dda45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:57.496672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c8c43-87fd-4c4b-91e8-2311427dda45 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:57.497457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c8c43-87fd-4c4b-91e8-2311427dda45 admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f757256b0c684c61a90421d1aec1d31d) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:57.497757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c8c43-87fd-4c4b-91e8-2311427dda45 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:57.523536 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c8c43-87fd-4c4b-91e8-2311427dda45 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:57.529494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 458/917] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:23:57 2021] GET /identity/v3/role_assignments?user.id=f757256b0c684c61a90421d1aec1d31d&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:59.567275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b7f6f-4970-457b-b593-9a90f834f308 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.567810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b7f6f-4970-457b-b593-9a90f834f308 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.567810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b7f6f-4970-457b-b593-9a90f834f308 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.569463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 460/918] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:23:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:23:59.574949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501ad91-1b98-40b8-b1cd-52eecf0e609e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.575400 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501ad91-1b98-40b8-b1cd-52eecf0e609e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.575503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501ad91-1b98-40b8-b1cd-52eecf0e609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.684122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f501ad91-1b98-40b8-b1cd-52eecf0e609e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:23:59.685301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f501ad91-1b98-40b8-b1cd-52eecf0e609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:23:59.692938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 459/919] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:23:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:23:59.715308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b7f6f-4970-457b-b593-9a90f834f308 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:59.727647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b7f6f-4970-457b-b593-9a90f834f308 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:59.732113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d82f7-7b5d-4432-8e5d-ba754d91dc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:59.732858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d82f7-7b5d-4432-8e5d-ba754d91dc91 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.733143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d82f7-7b5d-4432-8e5d-ba754d91dc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.733419 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d82f7-7b5d-4432-8e5d-ba754d91dc91 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.745217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d82f7-7b5d-4432-8e5d-ba754d91dc91 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:23:59.751643 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-af4d82f7-7b5d-4432-8e5d-ba754d91dc91 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:23:59.752769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 461/920] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:59.759064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501ad91-1b98-40b8-b1cd-52eecf0e609e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:59.768390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501ad91-1b98-40b8-b1cd-52eecf0e609e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:59.773786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ebe1-252e-4bc0-8586-79fc2bd87f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:59.774430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ebe1-252e-4bc0-8586-79fc2bd87f2e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.774713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ebe1-252e-4bc0-8586-79fc2bd87f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.774987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ebe1-252e-4bc0-8586-79fc2bd87f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.775712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ebe1-252e-4bc0-8586-79fc2bd87f2e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:59.776008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ebe1-252e-4bc0-8586-79fc2bd87f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:59.802037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ebe1-252e-4bc0-8586-79fc2bd87f2e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:59.811949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 460/921] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:23:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:59.818285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d82f7-7b5d-4432-8e5d-ba754d91dc91 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:59.828727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d82f7-7b5d-4432-8e5d-ba754d91dc91 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:59.834466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447b4b-2cb2-4e9a-89fe-999232a2b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:59.835192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447b4b-2cb2-4e9a-89fe-999232a2b410 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.835474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447b4b-2cb2-4e9a-89fe-999232a2b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.835748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447b4b-2cb2-4e9a-89fe-999232a2b410 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.848025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a447b4b-2cb2-4e9a-89fe-999232a2b410 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:59.873686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a447b4b-2cb2-4e9a-89fe-999232a2b410 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:59.893219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-7a447b4b-2cb2-4e9a-89fe-999232a2b410 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:23:59.894391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 462/922] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:23:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:23:59.900585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ebe1-252e-4bc0-8586-79fc2bd87f2e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:59.910984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ebe1-252e-4bc0-8586-79fc2bd87f2e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:59.916413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615f18-cac7-4434-885c-1b6c9f133042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:59.917007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615f18-cac7-4434-885c-1b6c9f133042 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.917292 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615f18-cac7-4434-885c-1b6c9f133042 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.917571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615f18-cac7-4434-885c-1b6c9f133042 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.918293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615f18-cac7-4434-885c-1b6c9f133042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:23:59.918593 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615f18-cac7-4434-885c-1b6c9f133042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:23:59.944274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615f18-cac7-4434-885c-1b6c9f133042 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:23:59.958737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 461/923] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:23:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:23:59.964766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447b4b-2cb2-4e9a-89fe-999232a2b410 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:23:59.974665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447b4b-2cb2-4e9a-89fe-999232a2b410 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:23:59.979247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5daaf-fb8b-4c47-8092-ee902396b7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:23:59.979995 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5daaf-fb8b-4c47-8092-ee902396b7ae admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:23:59.980277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5daaf-fb8b-4c47-8092-ee902396b7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:23:59.980562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5daaf-fb8b-4c47-8092-ee902396b7ae admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:23:59.993751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5daaf-fb8b-4c47-8092-ee902396b7ae admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:00.020072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5daaf-fb8b-4c47-8092-ee902396b7ae admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:00.039050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-52e5daaf-fb8b-4c47-8092-ee902396b7ae admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:24:00.040169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 463/924] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:23:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:24:00.046389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615f18-cac7-4434-885c-1b6c9f133042 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:00.057202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615f18-cac7-4434-885c-1b6c9f133042 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:00.062631 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c79abb-6dca-4143-aa80-0230034603f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:00.063224 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79abb-6dca-4143-aa80-0230034603f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:00.063832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79abb-6dca-4143-aa80-0230034603f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:00.063832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79abb-6dca-4143-aa80-0230034603f8 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:00.064552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c79abb-6dca-4143-aa80-0230034603f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:00.064847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c79abb-6dca-4143-aa80-0230034603f8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:00.090644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c79abb-6dca-4143-aa80-0230034603f8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:00.125022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 462/925] 10.222.0.67 () {56 vars in 1156 bytes} [Thu Dec 16 14:24:00 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:00.126479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5daaf-fb8b-4c47-8092-ee902396b7ae admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:00.136278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5daaf-fb8b-4c47-8092-ee902396b7ae admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:00.140748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c591d-760d-43a6-ad82-3aff772da51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:00.141320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c591d-760d-43a6-ad82-3aff772da51a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:00.142227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c591d-760d-43a6-ad82-3aff772da51a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:00.142227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c591d-760d-43a6-ad82-3aff772da51a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:00.150402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c591d-760d-43a6-ad82-3aff772da51a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:00.176478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c591d-760d-43a6-ad82-3aff772da51a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:00.186255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 464/926] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:24:00.192716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c79abb-6dca-4143-aa80-0230034603f8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:00.202350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c79abb-6dca-4143-aa80-0230034603f8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:00.208055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1019535-0981-4909-92fb-7b2cf1c7e442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:00.208822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019535-0981-4909-92fb-7b2cf1c7e442 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:00.209103 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019535-0981-4909-92fb-7b2cf1c7e442 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:00.209384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019535-0981-4909-92fb-7b2cf1c7e442 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:00.221605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1019535-0981-4909-92fb-7b2cf1c7e442 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:00.247850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1019535-0981-4909-92fb-7b2cf1c7e442 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:00.266104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-a1019535-0981-4909-92fb-7b2cf1c7e442 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:00.267365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 463/927] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:00.273574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c591d-760d-43a6-ad82-3aff772da51a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:00.283599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c591d-760d-43a6-ad82-3aff772da51a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:00.288733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03209b-fe29-431f-81e0-94095262228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:00.289327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03209b-fe29-431f-81e0-94095262228c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:00.289613 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03209b-fe29-431f-81e0-94095262228c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:00.289892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03209b-fe29-431f-81e0-94095262228c admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:00.290621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03209b-fe29-431f-81e0-94095262228c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:00.290926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03209b-fe29-431f-81e0-94095262228c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:00.317675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03209b-fe29-431f-81e0-94095262228c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:00.331854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 465/928] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:00.338028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1019535-0981-4909-92fb-7b2cf1c7e442 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:00.348508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1019535-0981-4909-92fb-7b2cf1c7e442 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:00.353506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a1c41-8252-434f-8a6e-cfc6435bc592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:00.354293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a1c41-8252-434f-8a6e-cfc6435bc592 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:00.354571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a1c41-8252-434f-8a6e-cfc6435bc592 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:00.354838 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a1c41-8252-434f-8a6e-cfc6435bc592 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:00.364944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a1c41-8252-434f-8a6e-cfc6435bc592 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:00.390825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a1c41-8252-434f-8a6e-cfc6435bc592 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:00.405101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-5b7a1c41-8252-434f-8a6e-cfc6435bc592 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:00.406256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 464/929] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:00.412680 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03209b-fe29-431f-81e0-94095262228c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:00.423200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03209b-fe29-431f-81e0-94095262228c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:00.428229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d7653-b2a7-48e6-b51e-11ef73dca682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:00.428803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d7653-b2a7-48e6-b51e-11ef73dca682 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:00.429092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d7653-b2a7-48e6-b51e-11ef73dca682 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:00.429372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d7653-b2a7-48e6-b51e-11ef73dca682 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:00.430165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d7653-b2a7-48e6-b51e-11ef73dca682 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:00.430467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d7653-b2a7-48e6-b51e-11ef73dca682 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:00.459376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d7653-b2a7-48e6-b51e-11ef73dca682 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:00.473225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 466/930] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:00.488305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a1c41-8252-434f-8a6e-cfc6435bc592 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:00.498225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a1c41-8252-434f-8a6e-cfc6435bc592 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:00.503419 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab833e29-dec2-4646-953a-8aacd5ae04f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:00.504023 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab833e29-dec2-4646-953a-8aacd5ae04f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:00.504309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab833e29-dec2-4646-953a-8aacd5ae04f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:00.504587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab833e29-dec2-4646-953a-8aacd5ae04f3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:00.505372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab833e29-dec2-4646-953a-8aacd5ae04f3 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f757256b0c684c61a90421d1aec1d31d) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:00.505679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab833e29-dec2-4646-953a-8aacd5ae04f3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:00.531811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab833e29-dec2-4646-953a-8aacd5ae04f3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:00.538075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 465/931] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:00 2021] GET /identity/v3/role_assignments?user.id=f757256b0c684c61a90421d1aec1d31d&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:02.494814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c444b-71d9-4956-9ff6-b34a8923db28 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:02.495317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c444b-71d9-4956-9ff6-b34a8923db28 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:02.495317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c444b-71d9-4956-9ff6-b34a8923db28 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:02.496980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 467/932] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:02.502700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a4d59-a440-4f73-acff-fd73635fd2b7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:02.503108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a4d59-a440-4f73-acff-fd73635fd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:02.503253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a4d59-a440-4f73-acff-fd73635fd2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:02.527238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-860a4d59-a440-4f73-acff-fd73635fd2b7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:02.528377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-860a4d59-a440-4f73-acff-fd73635fd2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:02.537061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 466/933] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:02.567132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c444b-71d9-4956-9ff6-b34a8923db28 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:02.580280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c444b-71d9-4956-9ff6-b34a8923db28 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:02.585067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ea3f-310c-4488-a74e-71fd1c3443ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:02.585808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ea3f-310c-4488-a74e-71fd1c3443ce admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:02.586127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ea3f-310c-4488-a74e-71fd1c3443ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:02.586397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ea3f-310c-4488-a74e-71fd1c3443ce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:02.598621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858ea3f-310c-4488-a74e-71fd1c3443ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:24:02.605156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-8858ea3f-310c-4488-a74e-71fd1c3443ce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:24:02.606373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 468/934] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:02.613138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a4d59-a440-4f73-acff-fd73635fd2b7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:02.622449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a4d59-a440-4f73-acff-fd73635fd2b7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:02.628221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f617e-b264-4455-b2c0-6a515320f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:02.628816 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f617e-b264-4455-b2c0-6a515320f40a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:02.629095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f617e-b264-4455-b2c0-6a515320f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:02.629376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f617e-b264-4455-b2c0-6a515320f40a admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:02.630119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f617e-b264-4455-b2c0-6a515320f40a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:02.630420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f617e-b264-4455-b2c0-6a515320f40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:02.655977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f617e-b264-4455-b2c0-6a515320f40a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:02.665808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 467/935] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:02.672236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ea3f-310c-4488-a74e-71fd1c3443ce admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:02.682508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ea3f-310c-4488-a74e-71fd1c3443ce admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:02.687813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ac5d-c233-43f8-b043-ff0b3393918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:02.688622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ac5d-c233-43f8-b043-ff0b3393918b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:02.688900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ac5d-c233-43f8-b043-ff0b3393918b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:02.689171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ac5d-c233-43f8-b043-ff0b3393918b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:02.701063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637ac5d-c233-43f8-b043-ff0b3393918b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:02.726942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637ac5d-c233-43f8-b043-ff0b3393918b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:02.745384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-a637ac5d-c233-43f8-b043-ff0b3393918b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:02.746462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 469/936] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:02.752563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f617e-b264-4455-b2c0-6a515320f40a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:02.762544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f617e-b264-4455-b2c0-6a515320f40a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:02.767993 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77d504-ff2a-4844-9d3f-3876bf65c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:02.768577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77d504-ff2a-4844-9d3f-3876bf65c827 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:02.768857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77d504-ff2a-4844-9d3f-3876bf65c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:02.769127 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77d504-ff2a-4844-9d3f-3876bf65c827 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:02.769807 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77d504-ff2a-4844-9d3f-3876bf65c827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:02.770125 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77d504-ff2a-4844-9d3f-3876bf65c827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:02.795479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77d504-ff2a-4844-9d3f-3876bf65c827 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:02.809461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 468/937] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:02.815503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ac5d-c233-43f8-b043-ff0b3393918b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:02.825469 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ac5d-c233-43f8-b043-ff0b3393918b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:02.831278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce78be3-6f8e-4991-a983-915042af6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:02.832055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce78be3-6f8e-4991-a983-915042af6f10 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:02.832340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce78be3-6f8e-4991-a983-915042af6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:02.832600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce78be3-6f8e-4991-a983-915042af6f10 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:02.847943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce78be3-6f8e-4991-a983-915042af6f10 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:02.873596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce78be3-6f8e-4991-a983-915042af6f10 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:02.892780 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-6ce78be3-6f8e-4991-a983-915042af6f10 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:24:02.893905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 470/938] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:02 2021] GET /identity/v3/users/swift => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:02.900020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77d504-ff2a-4844-9d3f-3876bf65c827 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:02.910222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77d504-ff2a-4844-9d3f-3876bf65c827 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:02.915148 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0c7aa-8ff4-4b13-9968-efab200e1eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:02.915747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0c7aa-8ff4-4b13-9968-efab200e1eed admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:02.916027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0c7aa-8ff4-4b13-9968-efab200e1eed admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:02.916284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0c7aa-8ff4-4b13-9968-efab200e1eed admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:02.917112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0c7aa-8ff4-4b13-9968-efab200e1eed admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:02.917412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0c7aa-8ff4-4b13-9968-efab200e1eed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:02.943338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0c7aa-8ff4-4b13-9968-efab200e1eed admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:02.973057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 469/939] 10.222.0.67 () {56 vars in 1156 bytes} [Thu Dec 16 14:24:02 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:02.979089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce78be3-6f8e-4991-a983-915042af6f10 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:02.988971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce78be3-6f8e-4991-a983-915042af6f10 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:02.993518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416596e-e57a-47cd-995e-88f720378d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:02.994303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416596e-e57a-47cd-995e-88f720378d6b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:02.994582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416596e-e57a-47cd-995e-88f720378d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:02.994858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416596e-e57a-47cd-995e-88f720378d6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.007687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416596e-e57a-47cd-995e-88f720378d6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:03.032814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416596e-e57a-47cd-995e-88f720378d6b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.050419 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-b416596e-e57a-47cd-995e-88f720378d6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:03.051568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 471/940] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:03.058247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0c7aa-8ff4-4b13-9968-efab200e1eed admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:03.069037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0c7aa-8ff4-4b13-9968-efab200e1eed admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:03.074431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307f94e-bb0b-405f-9740-555ccd051e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:03.075020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307f94e-bb0b-405f-9740-555ccd051e86 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.075307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307f94e-bb0b-405f-9740-555ccd051e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.075581 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307f94e-bb0b-405f-9740-555ccd051e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.076269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307f94e-bb0b-405f-9740-555ccd051e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:03.076565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307f94e-bb0b-405f-9740-555ccd051e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:03.101829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307f94e-bb0b-405f-9740-555ccd051e86 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.115553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 470/941] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:03.121495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416596e-e57a-47cd-995e-88f720378d6b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:03.131622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416596e-e57a-47cd-995e-88f720378d6b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:03.136723 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c432a1b-9c5e-406c-b577-fc0f379465bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:03.137448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c432a1b-9c5e-406c-b577-fc0f379465bf admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.137726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c432a1b-9c5e-406c-b577-fc0f379465bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.138035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c432a1b-9c5e-406c-b577-fc0f379465bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.147726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c432a1b-9c5e-406c-b577-fc0f379465bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:03.173447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c432a1b-9c5e-406c-b577-fc0f379465bf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.187867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-9c432a1b-9c5e-406c-b577-fc0f379465bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:03.188998 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 472/942] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:03.195134 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307f94e-bb0b-405f-9740-555ccd051e86 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:03.204804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307f94e-bb0b-405f-9740-555ccd051e86 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:03.209410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656666c-c92e-4972-8493-b0e6646664f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:03.209965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656666c-c92e-4972-8493-b0e6646664f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.210304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656666c-c92e-4972-8493-b0e6646664f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.210583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656666c-c92e-4972-8493-b0e6646664f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.211327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656666c-c92e-4972-8493-b0e6646664f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:03.211628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656666c-c92e-4972-8493-b0e6646664f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:03.237583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656666c-c92e-4972-8493-b0e6646664f7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.252523 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 471/943] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:03.258914 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c432a1b-9c5e-406c-b577-fc0f379465bf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:03.269365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c432a1b-9c5e-406c-b577-fc0f379465bf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:03.274830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e804d9-1032-4a3d-9bb8-284c8b3e0508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:03.275669 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e804d9-1032-4a3d-9bb8-284c8b3e0508 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:03.275954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e804d9-1032-4a3d-9bb8-284c8b3e0508 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:03.276231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e804d9-1032-4a3d-9bb8-284c8b3e0508 admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f757256b0c684c61a90421d1aec1d31d/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:03.278318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e804d9-1032-4a3d-9bb8-284c8b3e0508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=f757256b0c684c61a90421d1aec1d31d, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:03.305070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e804d9-1032-4a3d-9bb8-284c8b3e0508 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:03.320279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 473/944] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:24:03 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/f757256b0c684c61a90421d1aec1d31d/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:24:05.285033 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7342d-81a3-4d64-8f9b-96f706295f0e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.285613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7342d-81a3-4d64-8f9b-96f706295f0e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.285613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7342d-81a3-4d64-8f9b-96f706295f0e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.287343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 472/945] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:05.292785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d89d7b-33cf-4aef-9083-4b5e8303418f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.293229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d89d7b-33cf-4aef-9083-4b5e8303418f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.293315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d89d7b-33cf-4aef-9083-4b5e8303418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.318444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-63d89d7b-33cf-4aef-9083-4b5e8303418f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:05.319591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-63d89d7b-33cf-4aef-9083-4b5e8303418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:05.394853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 474/946] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:05.418416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7342d-81a3-4d64-8f9b-96f706295f0e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:05.432766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7342d-81a3-4d64-8f9b-96f706295f0e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:05.437811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2449ded-9f63-403c-8a4e-142335dad634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:05.438672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2449ded-9f63-403c-8a4e-142335dad634 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.438956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2449ded-9f63-403c-8a4e-142335dad634 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.439232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2449ded-9f63-403c-8a4e-142335dad634 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.451180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2449ded-9f63-403c-8a4e-142335dad634 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:24:05.457769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-e2449ded-9f63-403c-8a4e-142335dad634 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:24:05.458943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 473/947] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:05.465410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d89d7b-33cf-4aef-9083-4b5e8303418f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:05.474594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d89d7b-33cf-4aef-9083-4b5e8303418f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:05.479192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae70d18-2da4-4f8c-9a7b-fac383e51ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:05.479774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70d18-2da4-4f8c-9a7b-fac383e51ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.480055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70d18-2da4-4f8c-9a7b-fac383e51ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.480335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70d18-2da4-4f8c-9a7b-fac383e51ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.481053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae70d18-2da4-4f8c-9a7b-fac383e51ec7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:05.481355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae70d18-2da4-4f8c-9a7b-fac383e51ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:05.506816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae70d18-2da4-4f8c-9a7b-fac383e51ec7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:05.515753 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 475/948] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:05.521712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2449ded-9f63-403c-8a4e-142335dad634 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:05.532491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2449ded-9f63-403c-8a4e-142335dad634 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:05.537401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6b917-1d87-4ca8-814c-dff22663d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:05.538150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b917-1d87-4ca8-814c-dff22663d6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.538434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b917-1d87-4ca8-814c-dff22663d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.538706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b917-1d87-4ca8-814c-dff22663d6a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.551809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6b917-1d87-4ca8-814c-dff22663d6a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:05.577192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6b917-1d87-4ca8-814c-dff22663d6a9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:05.595875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-3fa6b917-1d87-4ca8-814c-dff22663d6a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:05.596999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 474/949] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:05.602970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae70d18-2da4-4f8c-9a7b-fac383e51ec7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:05.612963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae70d18-2da4-4f8c-9a7b-fac383e51ec7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:05.617500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686481-9451-4412-9523-9a707a6ae96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:05.618116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686481-9451-4412-9523-9a707a6ae96f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.618397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686481-9451-4412-9523-9a707a6ae96f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.618668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686481-9451-4412-9523-9a707a6ae96f admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.619379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01686481-9451-4412-9523-9a707a6ae96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:05.619668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01686481-9451-4412-9523-9a707a6ae96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:05.645323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01686481-9451-4412-9523-9a707a6ae96f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:05.659375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 476/950] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:05.665603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6b917-1d87-4ca8-814c-dff22663d6a9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:05.676266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6b917-1d87-4ca8-814c-dff22663d6a9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:05.681666 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e16ca-515a-4e31-8131-e6f3dd66fbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:05.682466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e16ca-515a-4e31-8131-e6f3dd66fbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.682749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e16ca-515a-4e31-8131-e6f3dd66fbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.683025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e16ca-515a-4e31-8131-e6f3dd66fbb0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.697464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e16ca-515a-4e31-8131-e6f3dd66fbb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:05.724379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e16ca-515a-4e31-8131-e6f3dd66fbb0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:05.744617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-f01e16ca-515a-4e31-8131-e6f3dd66fbb0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 16 14:24:05.745791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 475/951] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:05 2021] GET /identity/v3/users/swift => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:05.753577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686481-9451-4412-9523-9a707a6ae96f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:05.763635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686481-9451-4412-9523-9a707a6ae96f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:05.768768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151158e-062f-4882-a583-bd491b7d29e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:05.769369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151158e-062f-4882-a583-bd491b7d29e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.769656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151158e-062f-4882-a583-bd491b7d29e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.769935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151158e-062f-4882-a583-bd491b7d29e7 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.770767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151158e-062f-4882-a583-bd491b7d29e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:05.771067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151158e-062f-4882-a583-bd491b7d29e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:05.797234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151158e-062f-4882-a583-bd491b7d29e7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:05.828935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 477/952] 10.222.0.67 () {56 vars in 1156 bytes} [Thu Dec 16 14:24:05 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:05.835680 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e16ca-515a-4e31-8131-e6f3dd66fbb0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:05.846397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e16ca-515a-4e31-8131-e6f3dd66fbb0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:05.850963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819288d4-91a4-4632-9166-97ff2429cdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:05.851550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819288d4-91a4-4632-9166-97ff2429cdbb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.851832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819288d4-91a4-4632-9166-97ff2429cdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.852112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819288d4-91a4-4632-9166-97ff2429cdbb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.860356 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819288d4-91a4-4632-9166-97ff2429cdbb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:05.887044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819288d4-91a4-4632-9166-97ff2429cdbb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:05.898079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 476/953] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:05 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:05.904291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151158e-062f-4882-a583-bd491b7d29e7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:05.914378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151158e-062f-4882-a583-bd491b7d29e7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:05.919320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35b3c2-acab-4917-a9b1-c13e646dc498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:05.920055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35b3c2-acab-4917-a9b1-c13e646dc498 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:05.920339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35b3c2-acab-4917-a9b1-c13e646dc498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:05.920614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35b3c2-acab-4917-a9b1-c13e646dc498 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:05.935288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35b3c2-acab-4917-a9b1-c13e646dc498 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:05.962188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35b3c2-acab-4917-a9b1-c13e646dc498 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:05.982050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-7e35b3c2-acab-4917-a9b1-c13e646dc498 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:24:05.983285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 478/954] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:05.989634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819288d4-91a4-4632-9166-97ff2429cdbb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:05.999130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819288d4-91a4-4632-9166-97ff2429cdbb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:06.004675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fc38d-9f81-4645-80a0-d5df3e10e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:06.005279 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fc38d-9f81-4645-80a0-d5df3e10e7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:06.005559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fc38d-9f81-4645-80a0-d5df3e10e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:06.005830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fc38d-9f81-4645-80a0-d5df3e10e7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:06.006562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fc38d-9f81-4645-80a0-d5df3e10e7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:06.006854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fc38d-9f81-4645-80a0-d5df3e10e7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:06.032471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fc38d-9f81-4645-80a0-d5df3e10e7e3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:06.047178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 477/955] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:24:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:06.053301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35b3c2-acab-4917-a9b1-c13e646dc498 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:06.065500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35b3c2-acab-4917-a9b1-c13e646dc498 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:06.072513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819f3d-b747-4a82-bb65-88d04b019ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:06.073549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819f3d-b747-4a82-bb65-88d04b019ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:06.073935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819f3d-b747-4a82-bb65-88d04b019ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:06.074383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819f3d-b747-4a82-bb65-88d04b019ea7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:06.086239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54819f3d-b747-4a82-bb65-88d04b019ea7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:06.112097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54819f3d-b747-4a82-bb65-88d04b019ea7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:06.127026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-54819f3d-b747-4a82-bb65-88d04b019ea7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:24:06.128181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 479/956] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:24:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:06.134386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fc38d-9f81-4645-80a0-d5df3e10e7e3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:06.144277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fc38d-9f81-4645-80a0-d5df3e10e7e3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:06.148892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31e926-befa-438b-8483-3042df46fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:06.149423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31e926-befa-438b-8483-3042df46fa07 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:06.149708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31e926-befa-438b-8483-3042df46fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:06.150021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31e926-befa-438b-8483-3042df46fa07 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:06.150774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31e926-befa-438b-8483-3042df46fa07 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:06.151076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31e926-befa-438b-8483-3042df46fa07 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:06.177384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31e926-befa-438b-8483-3042df46fa07 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:06.191367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 478/957] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:24:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:06.197803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819f3d-b747-4a82-bb65-88d04b019ea7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:06.207964 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819f3d-b747-4a82-bb65-88d04b019ea7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:06.213349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3338519-b8d6-4932-826b-c7cd9197c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:06.213931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3338519-b8d6-4932-826b-c7cd9197c3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:06.214236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3338519-b8d6-4932-826b-c7cd9197c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:06.214509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3338519-b8d6-4932-826b-c7cd9197c3d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:06.215302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3338519-b8d6-4932-826b-c7cd9197c3d2 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=f757256b0c684c61a90421d1aec1d31d) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:06.215604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3338519-b8d6-4932-826b-c7cd9197c3d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:06.241867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3338519-b8d6-4932-826b-c7cd9197c3d2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:06.248221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 480/958] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:06 2021] GET /identity/v3/role_assignments?user.id=f757256b0c684c61a90421d1aec1d31d&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:08.253844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8b325-5d73-442e-8b7f-47479a5d964d None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.254504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8b325-5d73-442e-8b7f-47479a5d964d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.254504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8b325-5d73-442e-8b7f-47479a5d964d None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.256144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 479/959] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:08.261629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf943f4-ec3b-4e33-b32a-2749fbbb1af6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.262109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf943f4-ec3b-4e33-b32a-2749fbbb1af6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.262203 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf943f4-ec3b-4e33-b32a-2749fbbb1af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.286202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-8bf943f4-ec3b-4e33-b32a-2749fbbb1af6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:08.287398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8bf943f4-ec3b-4e33-b32a-2749fbbb1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:08.294768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 481/960] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:08.318452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8b325-5d73-442e-8b7f-47479a5d964d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:08.331488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8b325-5d73-442e-8b7f-47479a5d964d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:08.336535 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ba2df-b75b-48a9-8931-9c87483d6f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:08.337424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ba2df-b75b-48a9-8931-9c87483d6f86 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.337754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ba2df-b75b-48a9-8931-9c87483d6f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.338120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ba2df-b75b-48a9-8931-9c87483d6f86 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.338820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ba2df-b75b-48a9-8931-9c87483d6f86 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:08.373461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ba2df-b75b-48a9-8931-9c87483d6f86 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:08.386353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-4f4ba2df-b75b-48a9-8931-9c87483d6f86 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:24:08.387458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 480/961] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:24:08 2021] GET /identity/v3/services/object-store => generated 93 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:08.395662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf943f4-ec3b-4e33-b32a-2749fbbb1af6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:08.405082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf943f4-ec3b-4e33-b32a-2749fbbb1af6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:08.411011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f773fe-7c3c-4a3d-a0cf-8c0d52169cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:08.411617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f773fe-7c3c-4a3d-a0cf-8c0d52169cca admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.411907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f773fe-7c3c-4a3d-a0cf-8c0d52169cca admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.412187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f773fe-7c3c-4a3d-a0cf-8c0d52169cca admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.412889 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f773fe-7c3c-4a3d-a0cf-8c0d52169cca admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:08.413190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f773fe-7c3c-4a3d-a0cf-8c0d52169cca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:08.439389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f773fe-7c3c-4a3d-a0cf-8c0d52169cca admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:08.445081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 482/962] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:08 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:08.452072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ba2df-b75b-48a9-8931-9c87483d6f86 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:08.464450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ba2df-b75b-48a9-8931-9c87483d6f86 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:08.470500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362dc27-a916-49cd-87aa-f43bdf83b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:08.471130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362dc27-a916-49cd-87aa-f43bdf83b3aa admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:08.471408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362dc27-a916-49cd-87aa-f43bdf83b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:08.471702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362dc27-a916-49cd-87aa-f43bdf83b3aa admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:08.472380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362dc27-a916-49cd-87aa-f43bdf83b3aa admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:08.472672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362dc27-a916-49cd-87aa-f43bdf83b3aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:08.502726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362dc27-a916-49cd-87aa-f43bdf83b3aa admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:08.509372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 481/963] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:08 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:10.536491 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899db9c-f8fa-4807-b5a2-f2e0dfde48ff None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:10.537041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899db9c-f8fa-4807-b5a2-f2e0dfde48ff None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:10.537041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899db9c-f8fa-4807-b5a2-f2e0dfde48ff None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:10.538740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 483/964] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:10.548575 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f477-5399-44f4-af20-378af6a8a493 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:10.549176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f477-5399-44f4-af20-378af6a8a493 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:10.549176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f477-5399-44f4-af20-378af6a8a493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:10.575234 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-5a02f477-5399-44f4-af20-378af6a8a493 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:10.576413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5a02f477-5399-44f4-af20-378af6a8a493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:10.585389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 482/965] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:10.609378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899db9c-f8fa-4807-b5a2-f2e0dfde48ff None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:10.623428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899db9c-f8fa-4807-b5a2-f2e0dfde48ff None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:10.628495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5d1fb-a267-422b-9459-355498c0ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:10.629107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d1fb-a267-422b-9459-355498c0ddae admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:10.629394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d1fb-a267-422b-9459-355498c0ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:10.629676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d1fb-a267-422b-9459-355498c0ddae admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:10.630382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5d1fb-a267-422b-9459-355498c0ddae admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:10.656698 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5d1fb-a267-422b-9459-355498c0ddae admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:10.673519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 484/966] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:24:10 2021] POST /identity/v3/services => generated 241 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:12.688395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12114135-d102-426d-b90c-d4ec1efbfb18 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.688966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12114135-d102-426d-b90c-d4ec1efbfb18 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.688966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12114135-d102-426d-b90c-d4ec1efbfb18 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.692633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 483/967] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:12.699234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39260795-a317-4fef-84cc-5d4932bfd7a1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.699726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39260795-a317-4fef-84cc-5d4932bfd7a1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.699821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39260795-a317-4fef-84cc-5d4932bfd7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.736036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-39260795-a317-4fef-84cc-5d4932bfd7a1 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:12.737275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-39260795-a317-4fef-84cc-5d4932bfd7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:12.757622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 485/968] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:12 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:12.780654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12114135-d102-426d-b90c-d4ec1efbfb18 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:12.797711 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12114135-d102-426d-b90c-d4ec1efbfb18 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:12.804699 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d603b9-d320-419b-8d2e-0c5f1cc0fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:12.805480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d603b9-d320-419b-8d2e-0c5f1cc0fa29 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.805763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d603b9-d320-419b-8d2e-0c5f1cc0fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.806038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d603b9-d320-419b-8d2e-0c5f1cc0fa29 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.806714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d603b9-d320-419b-8d2e-0c5f1cc0fa29 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:12.833310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d603b9-d320-419b-8d2e-0c5f1cc0fa29 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:12.845863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-58d603b9-d320-419b-8d2e-0c5f1cc0fa29 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:24:12.847128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 484/969] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:24:12 2021] GET /identity/v3/services/object-store => generated 93 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:12.853795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39260795-a317-4fef-84cc-5d4932bfd7a1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:12.863621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39260795-a317-4fef-84cc-5d4932bfd7a1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:12.869033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e2b59-c727-43c5-b027-d6ca047bfda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:12.869641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e2b59-c727-43c5-b027-d6ca047bfda1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.869911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e2b59-c727-43c5-b027-d6ca047bfda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.870246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e2b59-c727-43c5-b027-d6ca047bfda1 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.870972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e2b59-c727-43c5-b027-d6ca047bfda1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:12.871266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e2b59-c727-43c5-b027-d6ca047bfda1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:12.896705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e2b59-c727-43c5-b027-d6ca047bfda1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:12.902847 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 486/970] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:12 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:12.909249 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d603b9-d320-419b-8d2e-0c5f1cc0fa29 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:12.919604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d603b9-d320-419b-8d2e-0c5f1cc0fa29 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:12.925475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3b1b8-0780-42ab-92e0-f6762543cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:12.926167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3b1b8-0780-42ab-92e0-f6762543cea9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:12.926454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3b1b8-0780-42ab-92e0-f6762543cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:12.926735 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3b1b8-0780-42ab-92e0-f6762543cea9 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:12.927414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3b1b8-0780-42ab-92e0-f6762543cea9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:12.927708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3b1b8-0780-42ab-92e0-f6762543cea9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:12.962381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3b1b8-0780-42ab-92e0-f6762543cea9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:12.967980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 485/971] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:12 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:12.974380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e2b59-c727-43c5-b027-d6ca047bfda1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:12.990331 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e2b59-c727-43c5-b027-d6ca047bfda1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:12.998677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c17ef3-04f2-4f6b-8288-8e31dcb22951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:13.001631 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c17ef3-04f2-4f6b-8288-8e31dcb22951 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:13.001945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c17ef3-04f2-4f6b-8288-8e31dcb22951 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:13.002252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c17ef3-04f2-4f6b-8288-8e31dcb22951 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:13.003021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c17ef3-04f2-4f6b-8288-8e31dcb22951 admin admin] RBAC: Adding query filter params (interface=public, service_id=75f242b5f1254155bbe64bb0ef574c2b, region_id=RegionOne) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:13.003322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c17ef3-04f2-4f6b-8288-8e31dcb22951 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:13.028491 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c17ef3-04f2-4f6b-8288-8e31dcb22951 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:13.034825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 487/972] 10.222.0.67 () {56 vars in 1272 bytes} [Thu Dec 16 14:24:12 2021] GET /identity/v3/endpoints?service_id=75f242b5f1254155bbe64bb0ef574c2b&interface=public®ion_id=RegionOne => generated 194 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:13.040808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3b1b8-0780-42ab-92e0-f6762543cea9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:13.051415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3b1b8-0780-42ab-92e0-f6762543cea9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:13.056889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f84d3-bcb3-4b90-9b4b-73e1bb205cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:13.057486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f84d3-bcb3-4b90-9b4b-73e1bb205cef admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:13.057768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f84d3-bcb3-4b90-9b4b-73e1bb205cef admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:13.058046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f84d3-bcb3-4b90-9b4b-73e1bb205cef admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:13.058730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f84d3-bcb3-4b90-9b4b-73e1bb205cef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:13.084088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f84d3-bcb3-4b90-9b4b-73e1bb205cef admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:13.091739 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 486/973] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:24:13 2021] GET /identity/v3/services => generated 2196 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:24:15.058582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b683cc-dc7e-440b-b6b7-469f8e610f22 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:15.059136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b683cc-dc7e-440b-b6b7-469f8e610f22 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:15.059136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b683cc-dc7e-440b-b6b7-469f8e610f22 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:15.062150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 488/974] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:15.068025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f924cc-a493-403e-96bc-2c1beeec05c5 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:15.068454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f924cc-a493-403e-96bc-2c1beeec05c5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:15.068578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f924cc-a493-403e-96bc-2c1beeec05c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:15.092769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d2f924cc-a493-403e-96bc-2c1beeec05c5 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:15.094315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d2f924cc-a493-403e-96bc-2c1beeec05c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:15.103211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 487/975] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:15 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:15.127637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b683cc-dc7e-440b-b6b7-469f8e610f22 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:15.142659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b683cc-dc7e-440b-b6b7-469f8e610f22 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:15.147766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335b126-bb63-4cab-a689-6c20e328082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:15.148552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335b126-bb63-4cab-a689-6c20e328082d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:15.148835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335b126-bb63-4cab-a689-6c20e328082d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:15.149202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335b126-bb63-4cab-a689-6c20e328082d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:15.149861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335b126-bb63-4cab-a689-6c20e328082d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:15.177567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335b126-bb63-4cab-a689-6c20e328082d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:15.190610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-1335b126-bb63-4cab-a689-6c20e328082d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:24:15.191807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 489/976] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:24:15 2021] GET /identity/v3/services/object-store => generated 93 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:15.198511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f924cc-a493-403e-96bc-2c1beeec05c5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:15.217099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f924cc-a493-403e-96bc-2c1beeec05c5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:15.222958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91278f93-5260-4441-bc56-7f69f90333f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:15.223577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278f93-5260-4441-bc56-7f69f90333f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:15.223859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278f93-5260-4441-bc56-7f69f90333f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:15.224142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278f93-5260-4441-bc56-7f69f90333f0 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:15.224848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91278f93-5260-4441-bc56-7f69f90333f0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:15.225139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91278f93-5260-4441-bc56-7f69f90333f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:15.250754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91278f93-5260-4441-bc56-7f69f90333f0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:15.258773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 488/977] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:15 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:15.265312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335b126-bb63-4cab-a689-6c20e328082d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:15.275364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335b126-bb63-4cab-a689-6c20e328082d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:15.280749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e56b2b-4a04-4b53-8f34-789c21668c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:15.281343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e56b2b-4a04-4b53-8f34-789c21668c3b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:15.281626 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e56b2b-4a04-4b53-8f34-789c21668c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:15.281905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e56b2b-4a04-4b53-8f34-789c21668c3b admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:15.282624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e56b2b-4a04-4b53-8f34-789c21668c3b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:15.282922 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e56b2b-4a04-4b53-8f34-789c21668c3b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:15.308381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e56b2b-4a04-4b53-8f34-789c21668c3b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:15.313921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 490/978] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:15 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:15.319984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91278f93-5260-4441-bc56-7f69f90333f0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:15.330613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91278f93-5260-4441-bc56-7f69f90333f0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:15.336017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0717a2-3090-41a0-b346-ce951ce9fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:15.336613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0717a2-3090-41a0-b346-ce951ce9fdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:15.336896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0717a2-3090-41a0-b346-ce951ce9fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:15.337174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0717a2-3090-41a0-b346-ce951ce9fdd2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:15.337878 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0717a2-3090-41a0-b346-ce951ce9fdd2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:15.364247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0717a2-3090-41a0-b346-ce951ce9fdd2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:15.385021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 489/979] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:24:15 2021] POST /identity/v3/endpoints => generated 349 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:17.398314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e38db-bf6e-4596-a2a7-2fa82eac967d None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.398881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e38db-bf6e-4596-a2a7-2fa82eac967d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.398881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e38db-bf6e-4596-a2a7-2fa82eac967d None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.400457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 491/980] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:17.405889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c6d09-878a-4fa7-8409-e414013741c7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.406386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c6d09-878a-4fa7-8409-e414013741c7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.406494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c6d09-878a-4fa7-8409-e414013741c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.431082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b42c6d09-878a-4fa7-8409-e414013741c7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:17.432253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b42c6d09-878a-4fa7-8409-e414013741c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:17.452084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 490/981] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:17.475358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e38db-bf6e-4596-a2a7-2fa82eac967d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.489192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e38db-bf6e-4596-a2a7-2fa82eac967d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.494129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46529c8-29f2-4004-b8c0-937432093f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.494867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46529c8-29f2-4004-b8c0-937432093f95 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.495155 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46529c8-29f2-4004-b8c0-937432093f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.495431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46529c8-29f2-4004-b8c0-937432093f95 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.496070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46529c8-29f2-4004-b8c0-937432093f95 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:17.521715 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46529c8-29f2-4004-b8c0-937432093f95 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.533521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-b46529c8-29f2-4004-b8c0-937432093f95 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:24:17.534682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 492/982] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/services/object-store => generated 93 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:17.541275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c6d09-878a-4fa7-8409-e414013741c7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.550968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c6d09-878a-4fa7-8409-e414013741c7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.556371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eec6c0-8b18-4706-a462-437c855475a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.556970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eec6c0-8b18-4706-a462-437c855475a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.557249 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eec6c0-8b18-4706-a462-437c855475a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.557525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eec6c0-8b18-4706-a462-437c855475a9 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.558237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eec6c0-8b18-4706-a462-437c855475a9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:17.558530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eec6c0-8b18-4706-a462-437c855475a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:17.584756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eec6c0-8b18-4706-a462-437c855475a9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.590286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 491/983] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:17.596701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46529c8-29f2-4004-b8c0-937432093f95 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.607709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46529c8-29f2-4004-b8c0-937432093f95 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.613121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba0033-cdae-40f9-a04d-e4933b2e4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.613715 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba0033-cdae-40f9-a04d-e4933b2e4904 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.614020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba0033-cdae-40f9-a04d-e4933b2e4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.614302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba0033-cdae-40f9-a04d-e4933b2e4904 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.614988 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba0033-cdae-40f9-a04d-e4933b2e4904 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:17.615286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba0033-cdae-40f9-a04d-e4933b2e4904 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:17.640587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba0033-cdae-40f9-a04d-e4933b2e4904 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.645836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 493/984] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:17.651891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eec6c0-8b18-4706-a462-437c855475a9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.661516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eec6c0-8b18-4706-a462-437c855475a9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.666134 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c276bd-fa2d-4cd9-9f58-894ffcd44fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.666716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c276bd-fa2d-4cd9-9f58-894ffcd44fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.667001 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c276bd-fa2d-4cd9-9f58-894ffcd44fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.667284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c276bd-fa2d-4cd9-9f58-894ffcd44fd1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.668029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c276bd-fa2d-4cd9-9f58-894ffcd44fd1 admin admin] RBAC: Adding query filter params (interface=admin, service_id=75f242b5f1254155bbe64bb0ef574c2b, region_id=RegionOne) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:17.668329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c276bd-fa2d-4cd9-9f58-894ffcd44fd1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:17.694474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c276bd-fa2d-4cd9-9f58-894ffcd44fd1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.699990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 492/985] 10.222.0.67 () {56 vars in 1270 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/endpoints?service_id=75f242b5f1254155bbe64bb0ef574c2b&interface=admin®ion_id=RegionOne => generated 193 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:17.705725 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba0033-cdae-40f9-a04d-e4933b2e4904 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:17.715317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba0033-cdae-40f9-a04d-e4933b2e4904 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:17.720264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654ae5e-352d-4293-8fad-d2714f970f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:17.720854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654ae5e-352d-4293-8fad-d2714f970f43 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:17.721139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654ae5e-352d-4293-8fad-d2714f970f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:17.721417 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654ae5e-352d-4293-8fad-d2714f970f43 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:17.722115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654ae5e-352d-4293-8fad-d2714f970f43 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:17.747333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654ae5e-352d-4293-8fad-d2714f970f43 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:17.754491 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 494/986] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:24:17 2021] GET /identity/v3/services => generated 2196 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:24:19.712790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82abc7-2389-4fe9-9dd4-c4ae7cdf644a None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.713398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82abc7-2389-4fe9-9dd4-c4ae7cdf644a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.713398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82abc7-2389-4fe9-9dd4-c4ae7cdf644a None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.715092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 493/987] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:19.720874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73564-c35e-4b3d-813f-3d785f5d654a None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.721281 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73564-c35e-4b3d-813f-3d785f5d654a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.721435 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73564-c35e-4b3d-813f-3d785f5d654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.744934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5ea73564-c35e-4b3d-813f-3d785f5d654a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:19.746156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5ea73564-c35e-4b3d-813f-3d785f5d654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:19.753922 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 495/988] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:19 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:19.777226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82abc7-2389-4fe9-9dd4-c4ae7cdf644a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:19.790974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82abc7-2389-4fe9-9dd4-c4ae7cdf644a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:19.796161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa578e-36f9-4f98-a0c7-99221e996b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:19.796913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa578e-36f9-4f98-a0c7-99221e996b8e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.797196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa578e-36f9-4f98-a0c7-99221e996b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.797470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa578e-36f9-4f98-a0c7-99221e996b8e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.798155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa578e-36f9-4f98-a0c7-99221e996b8e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:19.824678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa578e-36f9-4f98-a0c7-99221e996b8e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:19.836226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-94aa578e-36f9-4f98-a0c7-99221e996b8e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 16 14:24:19.837352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 494/989] 10.222.0.67 () {56 vars in 1147 bytes} [Thu Dec 16 14:24:19 2021] GET /identity/v3/services/object-store => generated 93 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:19.844048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea73564-c35e-4b3d-813f-3d785f5d654a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:19.853764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea73564-c35e-4b3d-813f-3d785f5d654a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:19.859384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9c08-e0be-4cd4-8d22-507072ead764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:19.859986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9c08-e0be-4cd4-8d22-507072ead764 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.860269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9c08-e0be-4cd4-8d22-507072ead764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.860546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9c08-e0be-4cd4-8d22-507072ead764 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.861230 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f9c08-e0be-4cd4-8d22-507072ead764 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:19.861528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f9c08-e0be-4cd4-8d22-507072ead764 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:19.886999 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f9c08-e0be-4cd4-8d22-507072ead764 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:19.892729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 496/990] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:19 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:19.898950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa578e-36f9-4f98-a0c7-99221e996b8e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:19.909057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa578e-36f9-4f98-a0c7-99221e996b8e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:19.914479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4683a1b-df04-4282-afdb-37193f3bcda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:19.915072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4683a1b-df04-4282-afdb-37193f3bcda0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.915353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4683a1b-df04-4282-afdb-37193f3bcda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.915626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4683a1b-df04-4282-afdb-37193f3bcda0 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.916299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4683a1b-df04-4282-afdb-37193f3bcda0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:19.916592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4683a1b-df04-4282-afdb-37193f3bcda0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:19.946412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4683a1b-df04-4282-afdb-37193f3bcda0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:19.951947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 495/991] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Dec 16 14:24:19 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:19.958714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9c08-e0be-4cd4-8d22-507072ead764 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:19.970699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9c08-e0be-4cd4-8d22-507072ead764 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:19.975202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0594592-2eba-46f0-8987-d96c57e9ad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:19.975793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0594592-2eba-46f0-8987-d96c57e9ad67 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:19.976057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0594592-2eba-46f0-8987-d96c57e9ad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:19.977247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0594592-2eba-46f0-8987-d96c57e9ad67 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:19.980187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0594592-2eba-46f0-8987-d96c57e9ad67 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:20.005557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0594592-2eba-46f0-8987-d96c57e9ad67 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:20.023411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 497/992] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:24:19 2021] POST /identity/v3/endpoints => generated 325 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:24:22.036474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077ec42-b4f6-4a7e-9ab8-82f6ac20ee74 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.037039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077ec42-b4f6-4a7e-9ab8-82f6ac20ee74 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.037039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077ec42-b4f6-4a7e-9ab8-82f6ac20ee74 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.038781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 496/993] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:22.045030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded09cf-6c09-498f-90cd-c854da2b93cc None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.045500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded09cf-6c09-498f-90cd-c854da2b93cc None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.045595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded09cf-6c09-498f-90cd-c854da2b93cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.069752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-aded09cf-6c09-498f-90cd-c854da2b93cc None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:22.070965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-aded09cf-6c09-498f-90cd-c854da2b93cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:22.090874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 498/994] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:22.114503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077ec42-b4f6-4a7e-9ab8-82f6ac20ee74 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.127313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077ec42-b4f6-4a7e-9ab8-82f6ac20ee74 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.131790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02eab7-1cb8-419d-891a-b08085500cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.132539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02eab7-1cb8-419d-891a-b08085500cbf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.132826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02eab7-1cb8-419d-891a-b08085500cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.133124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02eab7-1cb8-419d-891a-b08085500cbf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.134274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02eab7-1cb8-419d-891a-b08085500cbf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:22.160021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02eab7-1cb8-419d-891a-b08085500cbf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.161640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 497/995] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:22.167866 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded09cf-6c09-498f-90cd-c854da2b93cc None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:22.177377 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded09cf-6c09-498f-90cd-c854da2b93cc None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:22.182082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f480b8-2fee-4420-abd2-16ef7eef2102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:22.182677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f480b8-2fee-4420-abd2-16ef7eef2102 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:22.183032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f480b8-2fee-4420-abd2-16ef7eef2102 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:22.183314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f480b8-2fee-4420-abd2-16ef7eef2102 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:22.183978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f480b8-2fee-4420-abd2-16ef7eef2102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:22.209888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f480b8-2fee-4420-abd2-16ef7eef2102 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:22.239017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 499/996] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:24:22 2021] POST /identity/v3/projects => generated 311 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:24.251795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad6bdc-c28d-4ee8-9cff-e76fb42326d0 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:24.252397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad6bdc-c28d-4ee8-9cff-e76fb42326d0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:24.252571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad6bdc-c28d-4ee8-9cff-e76fb42326d0 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:24.254942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 498/997] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:24.260859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5ab2d-2506-4f4a-97c3-0b18a9bf3e27 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:24.261348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5ab2d-2506-4f4a-97c3-0b18a9bf3e27 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:24.261444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5ab2d-2506-4f4a-97c3-0b18a9bf3e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:24.288635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-70e5ab2d-2506-4f4a-97c3-0b18a9bf3e27 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:24.289794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-70e5ab2d-2506-4f4a-97c3-0b18a9bf3e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:24.356771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 500/998] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:24.381230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad6bdc-c28d-4ee8-9cff-e76fb42326d0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:24.395470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad6bdc-c28d-4ee8-9cff-e76fb42326d0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:24.400270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e664d-955a-49c2-8dfd-f6c420fb77bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:24.401000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e664d-955a-49c2-8dfd-f6c420fb77bb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:24.401287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e664d-955a-49c2-8dfd-f6c420fb77bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:24.401564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e664d-955a-49c2-8dfd-f6c420fb77bb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:24.402720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e664d-955a-49c2-8dfd-f6c420fb77bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:24.429497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e664d-955a-49c2-8dfd-f6c420fb77bb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:24.431031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 499/999] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:24.437740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5ab2d-2506-4f4a-97c3-0b18a9bf3e27 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:24.447085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5ab2d-2506-4f4a-97c3-0b18a9bf3e27 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:24.451649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfd4f2-6c84-4f54-95d9-39c392751e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:24.452275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd4f2-6c84-4f54-95d9-39c392751e33 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:24.452634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd4f2-6c84-4f54-95d9-39c392751e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:24.452945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd4f2-6c84-4f54-95d9-39c392751e33 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:24.453615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfd4f2-6c84-4f54-95d9-39c392751e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:24.479587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfd4f2-6c84-4f54-95d9-39c392751e33 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:24.503181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 501/1000] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:24:24 2021] POST /identity/v3/users => generated 285 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:26.500625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ec3ba-6215-4ef1-852f-9830567ac79c None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:26.501178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ec3ba-6215-4ef1-852f-9830567ac79c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:26.501178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ec3ba-6215-4ef1-852f-9830567ac79c None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:26.502834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 500/1001] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:24:26.508894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ca22a-76f1-43d0-bb7f-706190e53622 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:26.509449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ca22a-76f1-43d0-bb7f-706190e53622 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:26.509449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ca22a-76f1-43d0-bb7f-706190e53622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:26.534350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-ff7ca22a-76f1-43d0-bb7f-706190e53622 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:26.535553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ff7ca22a-76f1-43d0-bb7f-706190e53622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:26.545603 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 502/1002] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:26.570051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ec3ba-6215-4ef1-852f-9830567ac79c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:26.592766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ec3ba-6215-4ef1-852f-9830567ac79c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:26.598491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b57da-4aa8-4461-a955-b82b7f095100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:26.599236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b57da-4aa8-4461-a955-b82b7f095100 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:26.599513 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b57da-4aa8-4461-a955-b82b7f095100 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:26.599791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b57da-4aa8-4461-a955-b82b7f095100 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:26.614364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b57da-4aa8-4461-a955-b82b7f095100 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:24:26.620843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-af1b57da-4aa8-4461-a955-b82b7f095100 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:24:26.622034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 501/1003] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:26.628619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ca22a-76f1-43d0-bb7f-706190e53622 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:26.637449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ca22a-76f1-43d0-bb7f-706190e53622 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:26.641957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ba45-7c9f-42e5-977d-27275660ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:26.642609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ba45-7c9f-42e5-977d-27275660ed9f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:26.642862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ba45-7c9f-42e5-977d-27275660ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:26.643137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ba45-7c9f-42e5-977d-27275660ed9f admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:26.643857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ba45-7c9f-42e5-977d-27275660ed9f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:26.644159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ba45-7c9f-42e5-977d-27275660ed9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:26.669763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ba45-7c9f-42e5-977d-27275660ed9f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:26.679428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 503/1004] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:24:26.685570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b57da-4aa8-4461-a955-b82b7f095100 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:26.698555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b57da-4aa8-4461-a955-b82b7f095100 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:26.706432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8c9d5-13e6-46d2-b5a3-2265c2468e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:26.707380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8c9d5-13e6-46d2-b5a3-2265c2468e56 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:26.707845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8c9d5-13e6-46d2-b5a3-2265c2468e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:26.708309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8c9d5-13e6-46d2-b5a3-2265c2468e56 admin admin] PATH_INFO: `/v3/users/97e7314588aa4b369d6f07d066cd3da7` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:26.731924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8c9d5-13e6-46d2-b5a3-2265c2468e56 admin admin] RBAC: Authorizing `identity:get_user(user_id=97e7314588aa4b369d6f07d066cd3da7)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:26.758089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8c9d5-13e6-46d2-b5a3-2265c2468e56 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:26.759679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 502/1005] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:26 2021] GET /identity/v3/users/97e7314588aa4b369d6f07d066cd3da7 => generated 285 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:26.766094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ba45-7c9f-42e5-977d-27275660ed9f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:26.776133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ba45-7c9f-42e5-977d-27275660ed9f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:26.781606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6d804-3aa0-4646-b590-8f953792871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:26.782225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6d804-3aa0-4646-b590-8f953792871a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:26.782514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6d804-3aa0-4646-b590-8f953792871a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:26.782786 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6d804-3aa0-4646-b590-8f953792871a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:26.790767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6d804-3aa0-4646-b590-8f953792871a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:26.816927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6d804-3aa0-4646-b590-8f953792871a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:26.826516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 504/1006] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:26 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:26.832888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8c9d5-13e6-46d2-b5a3-2265c2468e56 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:26.843070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8c9d5-13e6-46d2-b5a3-2265c2468e56 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:26.848560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9ff93-5c16-42d7-b3d4-434b85f9a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:26.849357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9ff93-5c16-42d7-b3d4-434b85f9a2de admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:26.849640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9ff93-5c16-42d7-b3d4-434b85f9a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:26.849910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9ff93-5c16-42d7-b3d4-434b85f9a2de admin admin] PATH_INFO: `/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:26.851171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9ff93-5c16-42d7-b3d4-434b85f9a2de admin admin] RBAC: Authorizing `identity:get_project(project_id=1a005ad2a4cb4610a75fae6a82ec7241)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:26.877523 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9ff93-5c16-42d7-b3d4-434b85f9a2de admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:26.879180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 503/1007] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:24:26 2021] GET /identity/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:26.885876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6d804-3aa0-4646-b590-8f953792871a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:26.895329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6d804-3aa0-4646-b590-8f953792871a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:26.899876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84e800-cb24-45be-afff-2aad1cac5824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:26.900457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84e800-cb24-45be-afff-2aad1cac5824 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:26.900745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84e800-cb24-45be-afff-2aad1cac5824 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:26.901026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84e800-cb24-45be-afff-2aad1cac5824 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:26.901807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84e800-cb24-45be-afff-2aad1cac5824 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241, user.id=97e7314588aa4b369d6f07d066cd3da7) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:26.902153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84e800-cb24-45be-afff-2aad1cac5824 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:26.928040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84e800-cb24-45be-afff-2aad1cac5824 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:26.933871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 505/1008] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:26 2021] GET /identity/v3/role_assignments?user.id=97e7314588aa4b369d6f07d066cd3da7&scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:28.869941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51b4e3-a886-4589-9fc8-99016d426a81 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:28.870568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51b4e3-a886-4589-9fc8-99016d426a81 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:28.870568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51b4e3-a886-4589-9fc8-99016d426a81 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:28.872272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 504/1009] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:28.878589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d158-c4fa-4b0a-8bf5-53833e609789 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:28.879161 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d158-c4fa-4b0a-8bf5-53833e609789 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:28.879161 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d158-c4fa-4b0a-8bf5-53833e609789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:28.903131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-3e25d158-c4fa-4b0a-8bf5-53833e609789 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:28.904306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3e25d158-c4fa-4b0a-8bf5-53833e609789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:28.912987 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 506/1010] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:28.935782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51b4e3-a886-4589-9fc8-99016d426a81 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:28.953791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51b4e3-a886-4589-9fc8-99016d426a81 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:28.959743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d2daf-068e-40a6-9445-81310fc62147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:28.960452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d2daf-068e-40a6-9445-81310fc62147 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:28.960727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d2daf-068e-40a6-9445-81310fc62147 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:28.961008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d2daf-068e-40a6-9445-81310fc62147 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:28.974134 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d2daf-068e-40a6-9445-81310fc62147 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:24:28.980526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-a15d2daf-068e-40a6-9445-81310fc62147 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:24:28.981696 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 505/1011] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:28.988525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25d158-c4fa-4b0a-8bf5-53833e609789 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:28.997895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25d158-c4fa-4b0a-8bf5-53833e609789 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:29.003693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d964f-c7cb-4fc8-80e3-2b73a7ec9a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:29.004319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d964f-c7cb-4fc8-80e3-2b73a7ec9a02 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:29.004597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d964f-c7cb-4fc8-80e3-2b73a7ec9a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:29.004866 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d964f-c7cb-4fc8-80e3-2b73a7ec9a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:29.005587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d964f-c7cb-4fc8-80e3-2b73a7ec9a02 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:29.005881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d964f-c7cb-4fc8-80e3-2b73a7ec9a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:29.031271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d964f-c7cb-4fc8-80e3-2b73a7ec9a02 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:29.040796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 507/1012] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:29.047717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d2daf-068e-40a6-9445-81310fc62147 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:29.060499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d2daf-068e-40a6-9445-81310fc62147 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:29.065637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf460c70-030c-4442-a6a0-628cea374210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:29.066487 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf460c70-030c-4442-a6a0-628cea374210 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:29.066768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf460c70-030c-4442-a6a0-628cea374210 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:29.067046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf460c70-030c-4442-a6a0-628cea374210 admin admin] PATH_INFO: `/v3/users/97e7314588aa4b369d6f07d066cd3da7` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:29.068171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf460c70-030c-4442-a6a0-628cea374210 admin admin] RBAC: Authorizing `identity:get_user(user_id=97e7314588aa4b369d6f07d066cd3da7)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:29.094909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf460c70-030c-4442-a6a0-628cea374210 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:29.096497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 506/1013] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:29 2021] GET /identity/v3/users/97e7314588aa4b369d6f07d066cd3da7 => generated 285 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:29.102541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d964f-c7cb-4fc8-80e3-2b73a7ec9a02 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:29.112848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d964f-c7cb-4fc8-80e3-2b73a7ec9a02 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:29.118407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec30d2-d3b4-48e7-b511-c25ef6b47d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:29.119216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec30d2-d3b4-48e7-b511-c25ef6b47d11 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:29.119493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec30d2-d3b4-48e7-b511-c25ef6b47d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:29.119737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec30d2-d3b4-48e7-b511-c25ef6b47d11 admin admin] PATH_INFO: `/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:29.121145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec30d2-d3b4-48e7-b511-c25ef6b47d11 admin admin] RBAC: Authorizing `identity:get_project(project_id=1a005ad2a4cb4610a75fae6a82ec7241)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:29.147012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec30d2-d3b4-48e7-b511-c25ef6b47d11 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:29.148682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 508/1014] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:24:29 2021] GET /identity/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:29.155037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf460c70-030c-4442-a6a0-628cea374210 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:29.165702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf460c70-030c-4442-a6a0-628cea374210 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:29.171309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0058472-3bc8-4ca6-bc36-4f9853e5891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:29.172152 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0058472-3bc8-4ca6-bc36-4f9853e5891d admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:29.172835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0058472-3bc8-4ca6-bc36-4f9853e5891d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:29.172835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0058472-3bc8-4ca6-bc36-4f9853e5891d admin admin] PATH_INFO: `/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241/users/97e7314588aa4b369d6f07d066cd3da7/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:29.174807 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0058472-3bc8-4ca6-bc36-4f9853e5891d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a005ad2a4cb4610a75fae6a82ec7241, user_id=97e7314588aa4b369d6f07d066cd3da7, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:29.202592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0058472-3bc8-4ca6-bc36-4f9853e5891d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:29.217864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 507/1015] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:24:29 2021] PUT /identity/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241/users/97e7314588aa4b369d6f07d066cd3da7/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:24:31.167000 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58097924-806e-4eb2-9b51-f2a84070acb7 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:31.167552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58097924-806e-4eb2-9b51-f2a84070acb7 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:31.167552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58097924-806e-4eb2-9b51-f2a84070acb7 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:31.169546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 509/1016] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:31.175270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64e03f-9738-4e60-b5d9-0f8c94f798f7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:31.175720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64e03f-9738-4e60-b5d9-0f8c94f798f7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:31.175823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64e03f-9738-4e60-b5d9-0f8c94f798f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:31.207901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3f64e03f-9738-4e60-b5d9-0f8c94f798f7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:31.209061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3f64e03f-9738-4e60-b5d9-0f8c94f798f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:31.275759 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 508/1017] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:31.299637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58097924-806e-4eb2-9b51-f2a84070acb7 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:31.312771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58097924-806e-4eb2-9b51-f2a84070acb7 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:31.316976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2c26c-7920-4077-87e2-f964be2ed39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:31.317695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2c26c-7920-4077-87e2-f964be2ed39b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:31.317981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2c26c-7920-4077-87e2-f964be2ed39b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:31.318310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2c26c-7920-4077-87e2-f964be2ed39b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:31.330842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2c26c-7920-4077-87e2-f964be2ed39b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:24:31.337295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-2cb2c26c-7920-4077-87e2-f964be2ed39b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:24:31.338465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 510/1018] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:31.344990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64e03f-9738-4e60-b5d9-0f8c94f798f7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:31.354215 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64e03f-9738-4e60-b5d9-0f8c94f798f7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:31.359578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858919d-2180-4f38-b0bb-226dcd41c5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:31.360187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858919d-2180-4f38-b0bb-226dcd41c5ef admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:31.360465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858919d-2180-4f38-b0bb-226dcd41c5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:31.360737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858919d-2180-4f38-b0bb-226dcd41c5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:31.361460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858919d-2180-4f38-b0bb-226dcd41c5ef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:31.361793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858919d-2180-4f38-b0bb-226dcd41c5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:31.386953 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858919d-2180-4f38-b0bb-226dcd41c5ef admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:31.397191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 509/1019] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:31.403439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2c26c-7920-4077-87e2-f964be2ed39b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:31.414207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2c26c-7920-4077-87e2-f964be2ed39b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:31.420870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660f225-b10f-457f-a68d-da896d0461ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:31.421675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660f225-b10f-457f-a68d-da896d0461ee admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:31.421959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660f225-b10f-457f-a68d-da896d0461ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:31.422268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660f225-b10f-457f-a68d-da896d0461ee admin admin] PATH_INFO: `/v3/users/97e7314588aa4b369d6f07d066cd3da7` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:31.423504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660f225-b10f-457f-a68d-da896d0461ee admin admin] RBAC: Authorizing `identity:get_user(user_id=97e7314588aa4b369d6f07d066cd3da7)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:31.449506 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660f225-b10f-457f-a68d-da896d0461ee admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:31.451166 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 511/1020] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:31 2021] GET /identity/v3/users/97e7314588aa4b369d6f07d066cd3da7 => generated 285 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:31.457649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858919d-2180-4f38-b0bb-226dcd41c5ef admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:31.467305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858919d-2180-4f38-b0bb-226dcd41c5ef admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:31.472672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2758b9-5491-441f-81f2-ab901b45f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:31.473238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2758b9-5491-441f-81f2-ab901b45f03b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:31.473517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2758b9-5491-441f-81f2-ab901b45f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:31.473788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2758b9-5491-441f-81f2-ab901b45f03b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:31.482663 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2758b9-5491-441f-81f2-ab901b45f03b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:31.508248 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2758b9-5491-441f-81f2-ab901b45f03b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:31.517756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 510/1021] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:31 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:31.526731 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660f225-b10f-457f-a68d-da896d0461ee admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:31.536955 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660f225-b10f-457f-a68d-da896d0461ee admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:31.542202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e56eef-5db8-4deb-a179-bbe196122cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:31.542988 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e56eef-5db8-4deb-a179-bbe196122cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:31.543267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e56eef-5db8-4deb-a179-bbe196122cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:31.543539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e56eef-5db8-4deb-a179-bbe196122cb8 admin admin] PATH_INFO: `/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:31.545149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e56eef-5db8-4deb-a179-bbe196122cb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=1a005ad2a4cb4610a75fae6a82ec7241)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:31.571221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e56eef-5db8-4deb-a179-bbe196122cb8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:31.572877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 512/1022] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:24:31 2021] GET /identity/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:31.579648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2758b9-5491-441f-81f2-ab901b45f03b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:31.589732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2758b9-5491-441f-81f2-ab901b45f03b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:31.595073 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9065-fdd2-4afb-b5f7-b680fe30613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:31.595650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9065-fdd2-4afb-b5f7-b680fe30613b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:31.595915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9065-fdd2-4afb-b5f7-b680fe30613b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:31.596187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9065-fdd2-4afb-b5f7-b680fe30613b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:31.596962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9065-fdd2-4afb-b5f7-b680fe30613b admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241, user.id=97e7314588aa4b369d6f07d066cd3da7) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:31.597254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9065-fdd2-4afb-b5f7-b680fe30613b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:31.622549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9065-fdd2-4afb-b5f7-b680fe30613b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:31.628959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 511/1023] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:31 2021] GET /identity/v3/role_assignments?user.id=97e7314588aa4b369d6f07d066cd3da7&scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:33.615760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8d386-57f4-4153-88cd-a7cf41125060 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.616373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8d386-57f4-4153-88cd-a7cf41125060 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.616373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8d386-57f4-4153-88cd-a7cf41125060 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.618024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 513/1024] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:33.623727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7cfe5-0b0b-4f1c-8df5-3e94e8a1655d None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.624218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7cfe5-0b0b-4f1c-8df5-3e94e8a1655d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.624314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7cfe5-0b0b-4f1c-8df5-3e94e8a1655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.648094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-09a7cfe5-0b0b-4f1c-8df5-3e94e8a1655d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:33.649272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-09a7cfe5-0b0b-4f1c-8df5-3e94e8a1655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:33.656850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 512/1025] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:33 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:33.685780 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8d386-57f4-4153-88cd-a7cf41125060 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.698738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8d386-57f4-4153-88cd-a7cf41125060 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.703532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8bdb-9bdc-48b2-bc2d-cbe0f47e106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.704254 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8bdb-9bdc-48b2-bc2d-cbe0f47e106c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.704536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8bdb-9bdc-48b2-bc2d-cbe0f47e106c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.704811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8bdb-9bdc-48b2-bc2d-cbe0f47e106c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.705935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8bdb-9bdc-48b2-bc2d-cbe0f47e106c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:33.731292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8bdb-9bdc-48b2-bc2d-cbe0f47e106c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.733008 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 514/1026] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:33.739340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7cfe5-0b0b-4f1c-8df5-3e94e8a1655d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:33.749120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7cfe5-0b0b-4f1c-8df5-3e94e8a1655d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:33.754216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1bcee-850c-4e4b-8458-762bfd09d0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:33.754817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1bcee-850c-4e4b-8458-762bfd09d0dd admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:33.755096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1bcee-850c-4e4b-8458-762bfd09d0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:33.755353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1bcee-850c-4e4b-8458-762bfd09d0dd admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:33.756022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1bcee-850c-4e4b-8458-762bfd09d0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:33.782702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1bcee-850c-4e4b-8458-762bfd09d0dd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:33.806875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 513/1027] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:24:33 2021] POST /identity/v3/users => generated 286 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:35.828245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb520ef-1471-4021-a20a-d08db28e0a80 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:35.828840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb520ef-1471-4021-a20a-d08db28e0a80 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:35.828840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb520ef-1471-4021-a20a-d08db28e0a80 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:35.830538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 515/1028] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:35.835907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b0a48-3304-49f3-845b-d2187e82c3fb None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:35.836346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b0a48-3304-49f3-845b-d2187e82c3fb None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:35.836434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b0a48-3304-49f3-845b-d2187e82c3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:35.860431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d50b0a48-3304-49f3-845b-d2187e82c3fb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:35.861618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d50b0a48-3304-49f3-845b-d2187e82c3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:35.869478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 514/1029] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:35 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:35.892954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb520ef-1471-4021-a20a-d08db28e0a80 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:35.904844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb520ef-1471-4021-a20a-d08db28e0a80 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:35.909059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5af95-3d3f-455b-ab0a-f77fe5a15f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:35.909858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5af95-3d3f-455b-ab0a-f77fe5a15f48 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:35.910174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5af95-3d3f-455b-ab0a-f77fe5a15f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:35.910454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5af95-3d3f-455b-ab0a-f77fe5a15f48 admin admin] PATH_INFO: `/v3/roles/066e315d3c6b43edbbe4609b54fc3a2a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:35.911927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5af95-3d3f-455b-ab0a-f77fe5a15f48 admin admin] RBAC: Authorizing `identity:get_role(role_id=066e315d3c6b43edbbe4609b54fc3a2a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:35.937636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-abd5af95-3d3f-455b-ab0a-f77fe5a15f48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:35.937636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:24:35.937636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:24:35.938537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5af95-3d3f-455b-ab0a-f77fe5a15f48 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:35.939826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 516/1030] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:35 2021] GET /identity/v3/roles/066e315d3c6b43edbbe4609b54fc3a2a => generated 223 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:35.946327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b0a48-3304-49f3-845b-d2187e82c3fb None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:35.955482 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b0a48-3304-49f3-845b-d2187e82c3fb None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:35.960823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea03925-62a5-41f2-96b4-3a9742b93905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:35.961628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea03925-62a5-41f2-96b4-3a9742b93905 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:35.961910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea03925-62a5-41f2-96b4-3a9742b93905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:35.962211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea03925-62a5-41f2-96b4-3a9742b93905 admin admin] PATH_INFO: `/v3/users/0a6c5d872485449eb83793caca978cd5` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:35.981152 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea03925-62a5-41f2-96b4-3a9742b93905 admin admin] RBAC: Authorizing `identity:get_user(user_id=0a6c5d872485449eb83793caca978cd5)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:36.007512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea03925-62a5-41f2-96b4-3a9742b93905 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:36.009161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 515/1031] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:35 2021] GET /identity/v3/users/0a6c5d872485449eb83793caca978cd5 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:36.015483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5af95-3d3f-455b-ab0a-f77fe5a15f48 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:36.025642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5af95-3d3f-455b-ab0a-f77fe5a15f48 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:36.030606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ad1a7-609b-40c7-aac7-4c4ff1d5e736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:36.031178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ad1a7-609b-40c7-aac7-4c4ff1d5e736 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:36.031462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ad1a7-609b-40c7-aac7-4c4ff1d5e736 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:36.031723 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ad1a7-609b-40c7-aac7-4c4ff1d5e736 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:36.040167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ad1a7-609b-40c7-aac7-4c4ff1d5e736 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:36.066258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ad1a7-609b-40c7-aac7-4c4ff1d5e736 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:36.075807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 517/1032] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:36 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:36.082237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea03925-62a5-41f2-96b4-3a9742b93905 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:36.092241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea03925-62a5-41f2-96b4-3a9742b93905 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:36.097737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab261e5c-daca-42ac-bd30-f0f91a946a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:36.098566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab261e5c-daca-42ac-bd30-f0f91a946a39 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:36.098844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab261e5c-daca-42ac-bd30-f0f91a946a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:36.099115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab261e5c-daca-42ac-bd30-f0f91a946a39 admin admin] PATH_INFO: `/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:36.100364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab261e5c-daca-42ac-bd30-f0f91a946a39 admin admin] RBAC: Authorizing `identity:get_project(project_id=1a005ad2a4cb4610a75fae6a82ec7241)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:36.131028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab261e5c-daca-42ac-bd30-f0f91a946a39 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:36.132771 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 516/1033] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:24:36 2021] GET /identity/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241 => generated 311 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:36.140285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ad1a7-609b-40c7-aac7-4c4ff1d5e736 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:36.148869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ad1a7-609b-40c7-aac7-4c4ff1d5e736 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:36.154610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8585ef-3b59-452b-b104-d0f008975be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:36.155356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8585ef-3b59-452b-b104-d0f008975be3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:36.155791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8585ef-3b59-452b-b104-d0f008975be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:36.156122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8585ef-3b59-452b-b104-d0f008975be3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:36.157211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8585ef-3b59-452b-b104-d0f008975be3 admin admin] RBAC: Adding query filter params (role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241, user.id=0a6c5d872485449eb83793caca978cd5) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:36.157619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8585ef-3b59-452b-b104-d0f008975be3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:36.184272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8585ef-3b59-452b-b104-d0f008975be3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:36.190588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 518/1034] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:36 2021] GET /identity/v3/role_assignments?user.id=0a6c5d872485449eb83793caca978cd5&scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:24:38.137956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaea78-95e7-4d17-ada5-a765673a5141 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.137956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaea78-95e7-4d17-ada5-a765673a5141 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.137956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaea78-95e7-4d17-ada5-a765673a5141 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.140733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 517/1035] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:38.146905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09f251-becd-4664-8d1a-627b04dbaacf None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.147664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09f251-becd-4664-8d1a-627b04dbaacf None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.147820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09f251-becd-4664-8d1a-627b04dbaacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.172966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-db09f251-becd-4664-8d1a-627b04dbaacf None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:38.174133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-db09f251-becd-4664-8d1a-627b04dbaacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:38.181786 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 519/1036] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:38 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:38.204306 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaea78-95e7-4d17-ada5-a765673a5141 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.216933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaea78-95e7-4d17-ada5-a765673a5141 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.221436 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebb554-3d6a-4d55-a654-ac59b2345caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.222269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebb554-3d6a-4d55-a654-ac59b2345caf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.222553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebb554-3d6a-4d55-a654-ac59b2345caf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.222829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebb554-3d6a-4d55-a654-ac59b2345caf admin admin] PATH_INFO: `/v3/roles/066e315d3c6b43edbbe4609b54fc3a2a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.224216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebb554-3d6a-4d55-a654-ac59b2345caf admin admin] RBAC: Authorizing `identity:get_role(role_id=066e315d3c6b43edbbe4609b54fc3a2a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:38.248931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-16ebb554-3d6a-4d55-a654-ac59b2345caf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:38.248931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:24:38.248931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:24:38.249820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebb554-3d6a-4d55-a654-ac59b2345caf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.251190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 518/1037] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/roles/066e315d3c6b43edbbe4609b54fc3a2a => generated 223 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:38.257359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09f251-becd-4664-8d1a-627b04dbaacf None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.266981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09f251-becd-4664-8d1a-627b04dbaacf None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.271910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06905-5841-46f8-bcb6-5afe48e2ede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.272757 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06905-5841-46f8-bcb6-5afe48e2ede9 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.273043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06905-5841-46f8-bcb6-5afe48e2ede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.273325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06905-5841-46f8-bcb6-5afe48e2ede9 admin admin] PATH_INFO: `/v3/users/0a6c5d872485449eb83793caca978cd5` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.274576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc06905-5841-46f8-bcb6-5afe48e2ede9 admin admin] RBAC: Authorizing `identity:get_user(user_id=0a6c5d872485449eb83793caca978cd5)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:38.301135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc06905-5841-46f8-bcb6-5afe48e2ede9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.302722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 520/1038] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/users/0a6c5d872485449eb83793caca978cd5 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:38.309024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebb554-3d6a-4d55-a654-ac59b2345caf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.320108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebb554-3d6a-4d55-a654-ac59b2345caf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.324729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2a467-8066-4024-ad60-9c4fd9e8bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.325789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a467-8066-4024-ad60-9c4fd9e8bf71 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.326112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a467-8066-4024-ad60-9c4fd9e8bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.326410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a467-8066-4024-ad60-9c4fd9e8bf71 admin admin] PATH_INFO: `/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.327597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2a467-8066-4024-ad60-9c4fd9e8bf71 admin admin] RBAC: Authorizing `identity:get_project(project_id=1a005ad2a4cb4610a75fae6a82ec7241)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:38.353528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2a467-8066-4024-ad60-9c4fd9e8bf71 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.355483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 519/1039] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:24:38 2021] GET /identity/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:38.361578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06905-5841-46f8-bcb6-5afe48e2ede9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:38.371667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06905-5841-46f8-bcb6-5afe48e2ede9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:38.376865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac01c00-271c-4df6-80df-2b367db0003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:38.377743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac01c00-271c-4df6-80df-2b367db0003f admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:38.378011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac01c00-271c-4df6-80df-2b367db0003f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:38.378340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac01c00-271c-4df6-80df-2b367db0003f admin admin] PATH_INFO: `/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241/users/0a6c5d872485449eb83793caca978cd5/roles/066e315d3c6b43edbbe4609b54fc3a2a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:38.380525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac01c00-271c-4df6-80df-2b367db0003f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a005ad2a4cb4610a75fae6a82ec7241, user_id=0a6c5d872485449eb83793caca978cd5, role_id=066e315d3c6b43edbbe4609b54fc3a2a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:38.407465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac01c00-271c-4df6-80df-2b367db0003f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:38.423168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 521/1040] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:24:38 2021] PUT /identity/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241/users/0a6c5d872485449eb83793caca978cd5/roles/066e315d3c6b43edbbe4609b54fc3a2a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:24:40.382116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5c70-4efe-4b95-9d2c-6f64444c2b20 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.382694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5c70-4efe-4b95-9d2c-6f64444c2b20 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.382694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5c70-4efe-4b95-9d2c-6f64444c2b20 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.384363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 520/1041] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:40.389960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca635-c25a-49ad-a755-f154a7078830 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.390408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca635-c25a-49ad-a755-f154a7078830 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.390497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca635-c25a-49ad-a755-f154a7078830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.415099 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-ea0ca635-c25a-49ad-a755-f154a7078830 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:40.416248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ea0ca635-c25a-49ad-a755-f154a7078830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:40.484346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 522/1042] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:40.507916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa5c70-4efe-4b95-9d2c-6f64444c2b20 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.522034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa5c70-4efe-4b95-9d2c-6f64444c2b20 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.526968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372af23-db27-4f31-986b-672977045844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.527781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372af23-db27-4f31-986b-672977045844 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.528067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372af23-db27-4f31-986b-672977045844 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.528347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372af23-db27-4f31-986b-672977045844 admin admin] PATH_INFO: `/v3/roles/066e315d3c6b43edbbe4609b54fc3a2a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.529751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372af23-db27-4f31-986b-672977045844 admin admin] RBAC: Authorizing `identity:get_role(role_id=066e315d3c6b43edbbe4609b54fc3a2a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:40.555315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372af23-db27-4f31-986b-672977045844 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.556709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 521/1043] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/roles/066e315d3c6b43edbbe4609b54fc3a2a => generated 223 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:40.563087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ca635-c25a-49ad-a755-f154a7078830 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.572244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ca635-c25a-49ad-a755-f154a7078830 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.578272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567057e-15e0-496b-9553-7a47357259db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.579098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567057e-15e0-496b-9553-7a47357259db admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.579381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567057e-15e0-496b-9553-7a47357259db admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.579653 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567057e-15e0-496b-9553-7a47357259db admin admin] PATH_INFO: `/v3/users/0a6c5d872485449eb83793caca978cd5` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.580937 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567057e-15e0-496b-9553-7a47357259db admin admin] RBAC: Authorizing `identity:get_user(user_id=0a6c5d872485449eb83793caca978cd5)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:40.607863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567057e-15e0-496b-9553-7a47357259db admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.609400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 523/1044] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/users/0a6c5d872485449eb83793caca978cd5 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:40.615616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372af23-db27-4f31-986b-672977045844 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.626001 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372af23-db27-4f31-986b-672977045844 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.631481 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2851c-c452-4c92-9c2d-97263ed93228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.632067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2851c-c452-4c92-9c2d-97263ed93228 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.632351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2851c-c452-4c92-9c2d-97263ed93228 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.632626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2851c-c452-4c92-9c2d-97263ed93228 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.641464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2851c-c452-4c92-9c2d-97263ed93228 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:40.667181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2851c-c452-4c92-9c2d-97263ed93228 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.676427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 522/1045] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:40.682851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567057e-15e0-496b-9553-7a47357259db admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.693514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567057e-15e0-496b-9553-7a47357259db admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.698968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3a1d7-7568-454d-94ec-0f60ae65183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.699761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3a1d7-7568-454d-94ec-0f60ae65183e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.700043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3a1d7-7568-454d-94ec-0f60ae65183e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.700314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3a1d7-7568-454d-94ec-0f60ae65183e admin admin] PATH_INFO: `/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.702220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3a1d7-7568-454d-94ec-0f60ae65183e admin admin] RBAC: Authorizing `identity:get_project(project_id=1a005ad2a4cb4610a75fae6a82ec7241)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:40.728239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3a1d7-7568-454d-94ec-0f60ae65183e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.729927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 524/1046] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:40.736932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2851c-c452-4c92-9c2d-97263ed93228 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:40.746224 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2851c-c452-4c92-9c2d-97263ed93228 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:40.751983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53ff96-d8a3-48c7-a7cd-f98dd07d0e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:40.752564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ff96-d8a3-48c7-a7cd-f98dd07d0e9c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:40.752845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ff96-d8a3-48c7-a7cd-f98dd07d0e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:40.753122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ff96-d8a3-48c7-a7cd-f98dd07d0e9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:40.753907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ff96-d8a3-48c7-a7cd-f98dd07d0e9c admin admin] RBAC: Adding query filter params (role.id=066e315d3c6b43edbbe4609b54fc3a2a, scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241, user.id=0a6c5d872485449eb83793caca978cd5) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:40.754235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ff96-d8a3-48c7-a7cd-f98dd07d0e9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:40.779516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ff96-d8a3-48c7-a7cd-f98dd07d0e9c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:40.785788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 523/1047] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:40 2021] GET /identity/v3/role_assignments?user.id=0a6c5d872485449eb83793caca978cd5&scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241&role.id=066e315d3c6b43edbbe4609b54fc3a2a => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:42.842836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc3afa-87be-476e-8cb8-510bf19ec86d None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:42.843446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc3afa-87be-476e-8cb8-510bf19ec86d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:42.843446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc3afa-87be-476e-8cb8-510bf19ec86d None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:42.845074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 525/1048] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:42.850452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5b590-bcf3-43de-bca5-26550dd0d74e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:42.850890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5b590-bcf3-43de-bca5-26550dd0d74e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:42.851005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5b590-bcf3-43de-bca5-26550dd0d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:42.875006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c7d5b590-bcf3-43de-bca5-26550dd0d74e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:42.876151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c7d5b590-bcf3-43de-bca5-26550dd0d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:42.883624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 524/1049] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:42.908602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc3afa-87be-476e-8cb8-510bf19ec86d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:42.922712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc3afa-87be-476e-8cb8-510bf19ec86d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:42.927673 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944215b-fb52-4451-9856-c9effb3013fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:42.928393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944215b-fb52-4451-9856-c9effb3013fc admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:42.928679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944215b-fb52-4451-9856-c9effb3013fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:42.928952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944215b-fb52-4451-9856-c9effb3013fc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:42.930137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944215b-fb52-4451-9856-c9effb3013fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:42.955596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944215b-fb52-4451-9856-c9effb3013fc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:42.957150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 526/1050] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:42.963362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5b590-bcf3-43de-bca5-26550dd0d74e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:42.973305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5b590-bcf3-43de-bca5-26550dd0d74e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:42.978715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64d4f7-82d3-411e-b2f8-44ba7dbcce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:42.979305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64d4f7-82d3-411e-b2f8-44ba7dbcce84 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:42.979583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64d4f7-82d3-411e-b2f8-44ba7dbcce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:42.979858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64d4f7-82d3-411e-b2f8-44ba7dbcce84 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:42.980504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64d4f7-82d3-411e-b2f8-44ba7dbcce84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:43.007104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64d4f7-82d3-411e-b2f8-44ba7dbcce84 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:43.036489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 525/1051] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:24:42 2021] POST /identity/v3/projects => generated 311 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:45.073400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68f960-cf03-424e-bbf5-74e63f1230d2 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.073980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68f960-cf03-424e-bbf5-74e63f1230d2 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.073980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68f960-cf03-424e-bbf5-74e63f1230d2 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.076060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 527/1052] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:45.081556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff36f-64aa-4343-a85a-85d7c665a4d1 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.082026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff36f-64aa-4343-a85a-85d7c665a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.082146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff36f-64aa-4343-a85a-85d7c665a4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.105091 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-862ff36f-64aa-4343-a85a-85d7c665a4d1 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:45.106239 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-862ff36f-64aa-4343-a85a-85d7c665a4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:45.181302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 526/1053] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:45 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:24:45.205467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68f960-cf03-424e-bbf5-74e63f1230d2 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:45.218308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68f960-cf03-424e-bbf5-74e63f1230d2 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:45.222520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5899-4d58-4e2b-a083-d260efd11d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:45.223250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5899-4d58-4e2b-a083-d260efd11d44 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.223535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5899-4d58-4e2b-a083-d260efd11d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.223821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5899-4d58-4e2b-a083-d260efd11d44 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.225114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5899-4d58-4e2b-a083-d260efd11d44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:45.251015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5899-4d58-4e2b-a083-d260efd11d44 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:45.252711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 528/1054] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:24:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:45.258975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff36f-64aa-4343-a85a-85d7c665a4d1 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:45.268292 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff36f-64aa-4343-a85a-85d7c665a4d1 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:45.273726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850330f9-7bb2-438f-8653-4727592e70b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:45.274391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850330f9-7bb2-438f-8653-4727592e70b9 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:45.274691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850330f9-7bb2-438f-8653-4727592e70b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:45.274955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850330f9-7bb2-438f-8653-4727592e70b9 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:45.275643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850330f9-7bb2-438f-8653-4727592e70b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:45.305006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850330f9-7bb2-438f-8653-4727592e70b9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:45.335959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 527/1055] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:24:45 2021] POST /identity/v3/users => generated 286 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:47.358020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1846c-f714-484b-8824-81c96baff4b5 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:47.358636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1846c-f714-484b-8824-81c96baff4b5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:47.358636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1846c-f714-484b-8824-81c96baff4b5 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:47.360228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 529/1056] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:47.365977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164990fc-0c96-41e2-bdf9-5f3264c2ee3b None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:47.366469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164990fc-0c96-41e2-bdf9-5f3264c2ee3b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:47.366573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164990fc-0c96-41e2-bdf9-5f3264c2ee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:47.399387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-164990fc-0c96-41e2-bdf9-5f3264c2ee3b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:47.400452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-164990fc-0c96-41e2-bdf9-5f3264c2ee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:47.408203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 528/1057] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:47 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:24:47.432277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1846c-f714-484b-8824-81c96baff4b5 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:47.445827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1846c-f714-484b-8824-81c96baff4b5 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:47.451207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be4ffa-bcb4-41b0-97c8-bbdc532f9296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:47.451939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4ffa-bcb4-41b0-97c8-bbdc532f9296 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:47.452221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4ffa-bcb4-41b0-97c8-bbdc532f9296 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:47.452492 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4ffa-bcb4-41b0-97c8-bbdc532f9296 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:47.465562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be4ffa-bcb4-41b0-97c8-bbdc532f9296 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:24:47.472515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-68be4ffa-bcb4-41b0-97c8-bbdc532f9296 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:24:47.473651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 530/1058] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:47.480264 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164990fc-0c96-41e2-bdf9-5f3264c2ee3b None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:47.489873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164990fc-0c96-41e2-bdf9-5f3264c2ee3b None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:47.495450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8563e-8784-48b7-be66-0c8a96b80215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:47.496075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8563e-8784-48b7-be66-0c8a96b80215 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:47.496362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8563e-8784-48b7-be66-0c8a96b80215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:47.496636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8563e-8784-48b7-be66-0c8a96b80215 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:47.497452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8563e-8784-48b7-be66-0c8a96b80215 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:47.497749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8563e-8784-48b7-be66-0c8a96b80215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:47.523291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8563e-8784-48b7-be66-0c8a96b80215 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:47.532401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 529/1059] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:47.538721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be4ffa-bcb4-41b0-97c8-bbdc532f9296 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:47.549569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be4ffa-bcb4-41b0-97c8-bbdc532f9296 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:47.555415 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba4bec-a5a4-42cd-acf8-769939f0bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:47.556255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba4bec-a5a4-42cd-acf8-769939f0bba1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:47.556538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba4bec-a5a4-42cd-acf8-769939f0bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:47.556813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba4bec-a5a4-42cd-acf8-769939f0bba1 admin admin] PATH_INFO: `/v3/users/8d467b6286c04851a28298de9fdb6477` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:47.578778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba4bec-a5a4-42cd-acf8-769939f0bba1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d467b6286c04851a28298de9fdb6477)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:47.605067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba4bec-a5a4-42cd-acf8-769939f0bba1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:47.607209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 531/1060] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:47 2021] GET /identity/v3/users/8d467b6286c04851a28298de9fdb6477 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:47.613509 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8563e-8784-48b7-be66-0c8a96b80215 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:47.623796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8563e-8784-48b7-be66-0c8a96b80215 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:47.629261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23f44d-f632-4e9f-80cd-0fe860b6c8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:47.629837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23f44d-f632-4e9f-80cd-0fe860b6c8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:47.630153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23f44d-f632-4e9f-80cd-0fe860b6c8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:47.630438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23f44d-f632-4e9f-80cd-0fe860b6c8f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:47.639007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23f44d-f632-4e9f-80cd-0fe860b6c8f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:47.664653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23f44d-f632-4e9f-80cd-0fe860b6c8f2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:47.673828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 530/1061] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:47 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:47.680065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba4bec-a5a4-42cd-acf8-769939f0bba1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:47.690043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba4bec-a5a4-42cd-acf8-769939f0bba1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:47.694627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125d251-20e7-40c6-ad5e-c632264d2ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:47.695450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125d251-20e7-40c6-ad5e-c632264d2ffa admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:47.695735 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125d251-20e7-40c6-ad5e-c632264d2ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:47.696016 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125d251-20e7-40c6-ad5e-c632264d2ffa admin admin] PATH_INFO: `/v3/projects/51da8a0e339842cabf730613493a13d2` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:47.697138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125d251-20e7-40c6-ad5e-c632264d2ffa admin admin] RBAC: Authorizing `identity:get_project(project_id=51da8a0e339842cabf730613493a13d2)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:47.723862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125d251-20e7-40c6-ad5e-c632264d2ffa admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:47.725400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 532/1062] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:24:47 2021] GET /identity/v3/projects/51da8a0e339842cabf730613493a13d2 => generated 311 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:47.731521 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23f44d-f632-4e9f-80cd-0fe860b6c8f2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:47.740653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23f44d-f632-4e9f-80cd-0fe860b6c8f2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:47.746077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abb310-2483-45fb-81f2-3fce8350378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:47.746656 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb310-2483-45fb-81f2-3fce8350378c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:47.747067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb310-2483-45fb-81f2-3fce8350378c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:47.747496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb310-2483-45fb-81f2-3fce8350378c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:47.748281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abb310-2483-45fb-81f2-3fce8350378c admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=51da8a0e339842cabf730613493a13d2, user.id=8d467b6286c04851a28298de9fdb6477) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:47.748585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abb310-2483-45fb-81f2-3fce8350378c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:47.774028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abb310-2483-45fb-81f2-3fce8350378c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:47.780119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 531/1063] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:47 2021] GET /identity/v3/role_assignments?user.id=8d467b6286c04851a28298de9fdb6477&scope.project.id=51da8a0e339842cabf730613493a13d2&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:49.717019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2516c47-a872-4d5b-9217-325df16b2008 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:49.717655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2516c47-a872-4d5b-9217-325df16b2008 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:49.717655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2516c47-a872-4d5b-9217-325df16b2008 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:49.719309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 533/1064] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:49.724930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556f43c-4530-4057-8a96-cf79ee103af5 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:49.725414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556f43c-4530-4057-8a96-cf79ee103af5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:49.725522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556f43c-4530-4057-8a96-cf79ee103af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:49.748179 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f556f43c-4530-4057-8a96-cf79ee103af5 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:49.749300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f556f43c-4530-4057-8a96-cf79ee103af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:49.756864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 532/1065] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:49 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:24:49.780468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2516c47-a872-4d5b-9217-325df16b2008 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:49.793856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2516c47-a872-4d5b-9217-325df16b2008 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:49.798196 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848788c-99c9-49c2-b4fb-4c064a6ba080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:49.798938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848788c-99c9-49c2-b4fb-4c064a6ba080 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:49.799227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848788c-99c9-49c2-b4fb-4c064a6ba080 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:49.799503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848788c-99c9-49c2-b4fb-4c064a6ba080 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:49.812681 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848788c-99c9-49c2-b4fb-4c064a6ba080 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:24:49.819215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-6848788c-99c9-49c2-b4fb-4c064a6ba080 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:24:49.820383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 534/1066] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:49.827122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556f43c-4530-4057-8a96-cf79ee103af5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:49.836256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556f43c-4530-4057-8a96-cf79ee103af5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:49.841390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86855711-d9a0-4b9a-a1e6-a839eec280d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:49.842021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86855711-d9a0-4b9a-a1e6-a839eec280d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:49.842314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86855711-d9a0-4b9a-a1e6-a839eec280d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:49.842587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86855711-d9a0-4b9a-a1e6-a839eec280d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:49.843306 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86855711-d9a0-4b9a-a1e6-a839eec280d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:49.843602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86855711-d9a0-4b9a-a1e6-a839eec280d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:49.869057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86855711-d9a0-4b9a-a1e6-a839eec280d6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:49.878143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 533/1067] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:49.884351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848788c-99c9-49c2-b4fb-4c064a6ba080 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:49.895083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848788c-99c9-49c2-b4fb-4c064a6ba080 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:49.899504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ea90-a248-4ad9-9ee4-e5a4394d46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:49.900302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ea90-a248-4ad9-9ee4-e5a4394d46f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:49.900582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ea90-a248-4ad9-9ee4-e5a4394d46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:49.900860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ea90-a248-4ad9-9ee4-e5a4394d46f7 admin admin] PATH_INFO: `/v3/users/8d467b6286c04851a28298de9fdb6477` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:49.901952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ea90-a248-4ad9-9ee4-e5a4394d46f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d467b6286c04851a28298de9fdb6477)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:49.927913 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ea90-a248-4ad9-9ee4-e5a4394d46f7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:49.929379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 535/1068] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:49 2021] GET /identity/v3/users/8d467b6286c04851a28298de9fdb6477 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:49.935228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86855711-d9a0-4b9a-a1e6-a839eec280d6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:49.945111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86855711-d9a0-4b9a-a1e6-a839eec280d6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:49.950290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a667d-e913-42d3-9e63-159e1538b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:49.951048 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a667d-e913-42d3-9e63-159e1538b3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:49.951333 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a667d-e913-42d3-9e63-159e1538b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:49.951612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a667d-e913-42d3-9e63-159e1538b3b5 admin admin] PATH_INFO: `/v3/projects/51da8a0e339842cabf730613493a13d2` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:49.952843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a667d-e913-42d3-9e63-159e1538b3b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=51da8a0e339842cabf730613493a13d2)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:49.979204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a667d-e913-42d3-9e63-159e1538b3b5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:49.980685 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 534/1069] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:24:49 2021] GET /identity/v3/projects/51da8a0e339842cabf730613493a13d2 => generated 311 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:49.986993 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ea90-a248-4ad9-9ee4-e5a4394d46f7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:49.997130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ea90-a248-4ad9-9ee4-e5a4394d46f7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:50.002607 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d741b-1076-4a04-a5c2-ffe101c7aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:50.003412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d741b-1076-4a04-a5c2-ffe101c7aca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:50.003693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d741b-1076-4a04-a5c2-ffe101c7aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:50.003966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d741b-1076-4a04-a5c2-ffe101c7aca1 admin admin] PATH_INFO: `/v3/projects/51da8a0e339842cabf730613493a13d2/users/8d467b6286c04851a28298de9fdb6477/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:50.006032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d741b-1076-4a04-a5c2-ffe101c7aca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51da8a0e339842cabf730613493a13d2, user_id=8d467b6286c04851a28298de9fdb6477, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:50.032512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d741b-1076-4a04-a5c2-ffe101c7aca1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:50.047569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 536/1070] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:24:49 2021] PUT /identity/v3/projects/51da8a0e339842cabf730613493a13d2/users/8d467b6286c04851a28298de9fdb6477/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:24:52.035938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3a12d-ea4e-4651-be79-1b1b3393c4b1 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:52.036519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3a12d-ea4e-4651-be79-1b1b3393c4b1 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:52.036519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3a12d-ea4e-4651-be79-1b1b3393c4b1 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:52.038198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 535/1071] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:52.044444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755711aa-c159-4854-9283-61692385c86f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:52.045024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755711aa-c159-4854-9283-61692385c86f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:52.045024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755711aa-c159-4854-9283-61692385c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:52.069715 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-755711aa-c159-4854-9283-61692385c86f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:52.070908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-755711aa-c159-4854-9283-61692385c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:52.137815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 537/1072] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:52 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:52.161000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3a12d-ea4e-4651-be79-1b1b3393c4b1 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:52.174507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3a12d-ea4e-4651-be79-1b1b3393c4b1 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:52.178978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a1c54-7308-4d94-be12-ee9565979abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:52.179719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1c54-7308-4d94-be12-ee9565979abc admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:52.180002 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1c54-7308-4d94-be12-ee9565979abc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:52.180282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1c54-7308-4d94-be12-ee9565979abc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:52.192814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a1c54-7308-4d94-be12-ee9565979abc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:24:52.199353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-750a1c54-7308-4d94-be12-ee9565979abc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:24:52.200571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 536/1073] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:24:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:52.206941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755711aa-c159-4854-9283-61692385c86f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:52.215883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755711aa-c159-4854-9283-61692385c86f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:52.221300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef60c3-cd07-4343-8bc2-4e9f8c44cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:52.221895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef60c3-cd07-4343-8bc2-4e9f8c44cc06 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:52.222209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef60c3-cd07-4343-8bc2-4e9f8c44cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:52.222484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef60c3-cd07-4343-8bc2-4e9f8c44cc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:52.223207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef60c3-cd07-4343-8bc2-4e9f8c44cc06 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:52.223503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef60c3-cd07-4343-8bc2-4e9f8c44cc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:52.248901 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef60c3-cd07-4343-8bc2-4e9f8c44cc06 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:52.257774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 538/1074] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:24:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:52.264667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a1c54-7308-4d94-be12-ee9565979abc admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:52.275891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a1c54-7308-4d94-be12-ee9565979abc admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:52.280927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c68f84-d106-4b5c-8b8b-e42f1f95caa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:52.281760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c68f84-d106-4b5c-8b8b-e42f1f95caa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:52.282077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c68f84-d106-4b5c-8b8b-e42f1f95caa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:52.282353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c68f84-d106-4b5c-8b8b-e42f1f95caa1 admin admin] PATH_INFO: `/v3/users/8d467b6286c04851a28298de9fdb6477` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:52.283483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c68f84-d106-4b5c-8b8b-e42f1f95caa1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d467b6286c04851a28298de9fdb6477)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:52.310361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c68f84-d106-4b5c-8b8b-e42f1f95caa1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:52.311868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 537/1075] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:24:52 2021] GET /identity/v3/users/8d467b6286c04851a28298de9fdb6477 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:24:52.318133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef60c3-cd07-4343-8bc2-4e9f8c44cc06 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:52.328326 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef60c3-cd07-4343-8bc2-4e9f8c44cc06 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:52.333877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3ee1c-a251-441a-9353-511641d10249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:52.334505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3ee1c-a251-441a-9353-511641d10249 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:52.334789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3ee1c-a251-441a-9353-511641d10249 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:52.335087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3ee1c-a251-441a-9353-511641d10249 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:52.344118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3ee1c-a251-441a-9353-511641d10249 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:52.370367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3ee1c-a251-441a-9353-511641d10249 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:52.380673 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 539/1076] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:52 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:52.387002 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c68f84-d106-4b5c-8b8b-e42f1f95caa1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:52.397093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c68f84-d106-4b5c-8b8b-e42f1f95caa1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:52.401447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1081300-382c-44b7-8bd6-97215c923fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:52.402308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1081300-382c-44b7-8bd6-97215c923fdf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:52.402594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1081300-382c-44b7-8bd6-97215c923fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:52.402926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1081300-382c-44b7-8bd6-97215c923fdf admin admin] PATH_INFO: `/v3/projects/51da8a0e339842cabf730613493a13d2` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:52.404168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1081300-382c-44b7-8bd6-97215c923fdf admin admin] RBAC: Authorizing `identity:get_project(project_id=51da8a0e339842cabf730613493a13d2)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:52.430405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1081300-382c-44b7-8bd6-97215c923fdf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:52.432032 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 538/1077] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:24:52 2021] GET /identity/v3/projects/51da8a0e339842cabf730613493a13d2 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:52.438542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3ee1c-a251-441a-9353-511641d10249 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:52.447678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3ee1c-a251-441a-9353-511641d10249 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:52.453241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58bc97-d9fd-4393-8049-89ca6275a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:52.453819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bc97-d9fd-4393-8049-89ca6275a998 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:52.454132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bc97-d9fd-4393-8049-89ca6275a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:52.454412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bc97-d9fd-4393-8049-89ca6275a998 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:52.455188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58bc97-d9fd-4393-8049-89ca6275a998 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=51da8a0e339842cabf730613493a13d2, user.id=8d467b6286c04851a28298de9fdb6477) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:52.455478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58bc97-d9fd-4393-8049-89ca6275a998 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:52.481255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58bc97-d9fd-4393-8049-89ca6275a998 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:52.487929 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 540/1078] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:24:52 2021] GET /identity/v3/role_assignments?user.id=8d467b6286c04851a28298de9fdb6477&scope.project.id=51da8a0e339842cabf730613493a13d2&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:54.562542 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dae15-e727-4ed1-80b7-ec6d328e3c25 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:54.563071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dae15-e727-4ed1-80b7-ec6d328e3c25 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:54.563071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dae15-e727-4ed1-80b7-ec6d328e3c25 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:54.564767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 539/1079] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:54.570267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80684663-8feb-43c1-b91a-8d37597cc012 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:54.570687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80684663-8feb-43c1-b91a-8d37597cc012 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:54.570813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80684663-8feb-43c1-b91a-8d37597cc012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:54.594936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-80684663-8feb-43c1-b91a-8d37597cc012 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:54.596118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-80684663-8feb-43c1-b91a-8d37597cc012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:54.604808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 541/1080] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:54 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:54.627868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dae15-e727-4ed1-80b7-ec6d328e3c25 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:54.641853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dae15-e727-4ed1-80b7-ec6d328e3c25 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:54.646396 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08fad-c9a0-46d1-9336-71b95264bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:54.646993 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08fad-c9a0-46d1-9336-71b95264bf7f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:54.647283 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08fad-c9a0-46d1-9336-71b95264bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:54.647563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08fad-c9a0-46d1-9336-71b95264bf7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:54.655736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f08fad-c9a0-46d1-9336-71b95264bf7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:54.684512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f08fad-c9a0-46d1-9336-71b95264bf7f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:54.693877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 540/1081] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:24:54 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:24:54.700512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80684663-8feb-43c1-b91a-8d37597cc012 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:54.709448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80684663-8feb-43c1-b91a-8d37597cc012 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:54.714859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cd430-7812-425a-aa7b-3dfc5b26505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:54.715556 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cd430-7812-425a-aa7b-3dfc5b26505d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:54.715857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cd430-7812-425a-aa7b-3dfc5b26505d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:54.716125 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cd430-7812-425a-aa7b-3dfc5b26505d admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:54.724747 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cd430-7812-425a-aa7b-3dfc5b26505d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:54.750801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cd430-7812-425a-aa7b-3dfc5b26505d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:54.766363 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-064cd430-7812-425a-aa7b-3dfc5b26505d admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 16 14:24:54.767456 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 542/1082] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:24:54 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:24:54.773889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08fad-c9a0-46d1-9336-71b95264bf7f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:54.783310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08fad-c9a0-46d1-9336-71b95264bf7f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:54.788831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78d0cb-c615-43e7-956c-6f592ed02f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:54.789431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78d0cb-c615-43e7-956c-6f592ed02f22 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:54.789712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78d0cb-c615-43e7-956c-6f592ed02f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:54.790007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78d0cb-c615-43e7-956c-6f592ed02f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:54.790712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78d0cb-c615-43e7-956c-6f592ed02f22 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:24:54.791010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78d0cb-c615-43e7-956c-6f592ed02f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:54.817059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78d0cb-c615-43e7-956c-6f592ed02f22 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:54.825622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 541/1083] 10.222.0.67 () {56 vars in 1136 bytes} [Thu Dec 16 14:24:54 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:56.828886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c494a-20f0-4bf2-bda8-5637a3625e92 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:56.829470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c494a-20f0-4bf2-bda8-5637a3625e92 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:56.829470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c494a-20f0-4bf2-bda8-5637a3625e92 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:56.831202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 543/1084] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:56.836517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feb2c0-dea2-476c-b4ff-f96f976f5880 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:56.836960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feb2c0-dea2-476c-b4ff-f96f976f5880 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:56.837074 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feb2c0-dea2-476c-b4ff-f96f976f5880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:56.861286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c5feb2c0-dea2-476c-b4ff-f96f976f5880 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:56.862465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c5feb2c0-dea2-476c-b4ff-f96f976f5880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:56.869824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 542/1085] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:56 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:56.893521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c494a-20f0-4bf2-bda8-5637a3625e92 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:56.906985 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c494a-20f0-4bf2-bda8-5637a3625e92 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:56.911310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e0ff9-e8c5-49a0-895d-cc87e34ddd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:56.911887 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e0ff9-e8c5-49a0-895d-cc87e34ddd10 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:56.912171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e0ff9-e8c5-49a0-895d-cc87e34ddd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:56.912446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e0ff9-e8c5-49a0-895d-cc87e34ddd10 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:56.913156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e0ff9-e8c5-49a0-895d-cc87e34ddd10 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:56.939306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-9c2e0ff9-e8c5-49a0-895d-cc87e34ddd10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:24:56.939306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:24:56.939306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:24:56.940174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e0ff9-e8c5-49a0-895d-cc87e34ddd10 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:56.957825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 544/1086] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Dec 16 14:24:56 2021] POST /identity/v3/domains => generated 267 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:24:58.950349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c342e-74be-4083-96e1-cd2db5fdc0f5 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:58.950969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c342e-74be-4083-96e1-cd2db5fdc0f5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:58.950969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c342e-74be-4083-96e1-cd2db5fdc0f5 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:58.952617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 543/1087] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:24:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:24:58.958776 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b528-68ed-4bff-9d83-87a282e3cd3a None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:58.959376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b528-68ed-4bff-9d83-87a282e3cd3a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:58.959376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b528-68ed-4bff-9d83-87a282e3cd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:58.985244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-8745b528-68ed-4bff-9d83-87a282e3cd3a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:24:58.986496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8745b528-68ed-4bff-9d83-87a282e3cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:24:59.059903 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 545/1088] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:24:58 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:24:59.084578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c342e-74be-4083-96e1-cd2db5fdc0f5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:59.099856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c342e-74be-4083-96e1-cd2db5fdc0f5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:59.104207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765088bb-2d5e-4b2e-af8f-369e00732079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:59.105002 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765088bb-2d5e-4b2e-af8f-369e00732079 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:59.105285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765088bb-2d5e-4b2e-af8f-369e00732079 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:59.105567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765088bb-2d5e-4b2e-af8f-369e00732079 admin admin] PATH_INFO: `/v3/domains/0c770e624e5544a8a7a672ece069f6d9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:59.118688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765088bb-2d5e-4b2e-af8f-369e00732079 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=0c770e624e5544a8a7a672ece069f6d9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:59.144788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765088bb-2d5e-4b2e-af8f-369e00732079 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:59.146478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 544/1089] 10.222.0.67 () {56 vars in 1204 bytes} [Thu Dec 16 14:24:59 2021] GET /identity/v3/domains/0c770e624e5544a8a7a672ece069f6d9 => generated 267 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:24:59.153567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b528-68ed-4bff-9d83-87a282e3cd3a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:24:59.163026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b528-68ed-4bff-9d83-87a282e3cd3a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:24:59.170187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb029600-0721-4af8-86f8-792e7a26d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:24:59.170767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029600-0721-4af8-86f8-792e7a26d78d admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:24:59.171067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029600-0721-4af8-86f8-792e7a26d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:24:59.171329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029600-0721-4af8-86f8-792e7a26d78d admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:24:59.172005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb029600-0721-4af8-86f8-792e7a26d78d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:24:59.197965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb029600-0721-4af8-86f8-792e7a26d78d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:24:59.229208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 546/1090] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:24:59 2021] POST /identity/v3/projects => generated 361 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:01.297335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034482d8-9e40-41ff-a2af-5ee6088d3214 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:01.297917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034482d8-9e40-41ff-a2af-5ee6088d3214 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:01.297917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034482d8-9e40-41ff-a2af-5ee6088d3214 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:01.299662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 545/1091] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:25:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:01.305101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a371b4-4d29-4519-8c31-15b81fd8c67a None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:01.305566 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a371b4-4d29-4519-8c31-15b81fd8c67a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:01.305666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a371b4-4d29-4519-8c31-15b81fd8c67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:01.329407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-79a371b4-4d29-4519-8c31-15b81fd8c67a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:01.330564 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-79a371b4-4d29-4519-8c31-15b81fd8c67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:01.399193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 547/1092] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:01.424272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034482d8-9e40-41ff-a2af-5ee6088d3214 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:01.437045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034482d8-9e40-41ff-a2af-5ee6088d3214 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:01.441502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a8256-56fc-4951-980d-1f0328b9025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:01.442332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a8256-56fc-4951-980d-1f0328b9025d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:01.442618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a8256-56fc-4951-980d-1f0328b9025d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:01.442876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a8256-56fc-4951-980d-1f0328b9025d admin admin] PATH_INFO: `/v3/domains/0c770e624e5544a8a7a672ece069f6d9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:01.443992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a8256-56fc-4951-980d-1f0328b9025d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=0c770e624e5544a8a7a672ece069f6d9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:01.470413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a8256-56fc-4951-980d-1f0328b9025d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:01.471953 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 546/1093] 10.222.0.67 () {56 vars in 1204 bytes} [Thu Dec 16 14:25:01 2021] GET /identity/v3/domains/0c770e624e5544a8a7a672ece069f6d9 => generated 267 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:01.478103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a371b4-4d29-4519-8c31-15b81fd8c67a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:01.487408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a371b4-4d29-4519-8c31-15b81fd8c67a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:01.492991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090014e4-b81f-46e1-955f-f4186a39832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:01.493593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090014e4-b81f-46e1-955f-f4186a39832d admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:01.493880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090014e4-b81f-46e1-955f-f4186a39832d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:01.494182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090014e4-b81f-46e1-955f-f4186a39832d admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:01.494846 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090014e4-b81f-46e1-955f-f4186a39832d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:01.521011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090014e4-b81f-46e1-955f-f4186a39832d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:01.541675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 548/1094] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:25:01 2021] POST /identity/v3/users => generated 311 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:25:03.620515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd75e5e-36bd-43d6-acc3-b3e98a40b4da None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.621118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd75e5e-36bd-43d6-acc3-b3e98a40b4da None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.621118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd75e5e-36bd-43d6-acc3-b3e98a40b4da None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.622937 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 547/1095] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:25:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:03.628381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11401cf-9569-4774-87a9-22c14cd4ace9 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.628832 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11401cf-9569-4774-87a9-22c14cd4ace9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.628919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11401cf-9569-4774-87a9-22c14cd4ace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.653314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c11401cf-9569-4774-87a9-22c14cd4ace9 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:03.654509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c11401cf-9569-4774-87a9-22c14cd4ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:03.662275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 549/1096] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:03 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:03.687726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd75e5e-36bd-43d6-acc3-b3e98a40b4da None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:03.700679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd75e5e-36bd-43d6-acc3-b3e98a40b4da None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:03.704796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b017ac-3421-44f1-be32-f771a6b49342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:03.705584 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b017ac-3421-44f1-be32-f771a6b49342 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.705873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b017ac-3421-44f1-be32-f771a6b49342 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.706187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b017ac-3421-44f1-be32-f771a6b49342 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.719101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b017ac-3421-44f1-be32-f771a6b49342 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:25:03.725449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-38b017ac-3421-44f1-be32-f771a6b49342 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:25:03.726579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 548/1097] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:25:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:03.733276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11401cf-9569-4774-87a9-22c14cd4ace9 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:03.742459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11401cf-9569-4774-87a9-22c14cd4ace9 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:03.747949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817b5d5-4f47-407e-b841-5e058438a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:03.748549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817b5d5-4f47-407e-b841-5e058438a8bc admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.748827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817b5d5-4f47-407e-b841-5e058438a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.749105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817b5d5-4f47-407e-b841-5e058438a8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.749822 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817b5d5-4f47-407e-b841-5e058438a8bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:25:03.750151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817b5d5-4f47-407e-b841-5e058438a8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:03.775728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817b5d5-4f47-407e-b841-5e058438a8bc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:03.784983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 550/1098] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:25:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:03.791147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b017ac-3421-44f1-be32-f771a6b49342 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:03.802752 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b017ac-3421-44f1-be32-f771a6b49342 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:03.808228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4fcce-e89e-46d9-8db5-f67b947319d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:03.809096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4fcce-e89e-46d9-8db5-f67b947319d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.809380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4fcce-e89e-46d9-8db5-f67b947319d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.809665 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4fcce-e89e-46d9-8db5-f67b947319d2 admin admin] PATH_INFO: `/v3/users/aa106fe70f4b458a98fa495801d65613` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.831323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4fcce-e89e-46d9-8db5-f67b947319d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=aa106fe70f4b458a98fa495801d65613)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:03.857199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4fcce-e89e-46d9-8db5-f67b947319d2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:03.858777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 549/1099] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:25:03 2021] GET /identity/v3/users/aa106fe70f4b458a98fa495801d65613 => generated 311 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:03.864804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817b5d5-4f47-407e-b841-5e058438a8bc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:03.875076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817b5d5-4f47-407e-b841-5e058438a8bc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:03.880445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510082f-1b1d-4c50-8547-11e2c30bd818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:03.881020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510082f-1b1d-4c50-8547-11e2c30bd818 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.881305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510082f-1b1d-4c50-8547-11e2c30bd818 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.881576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510082f-1b1d-4c50-8547-11e2c30bd818 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.890353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510082f-1b1d-4c50-8547-11e2c30bd818 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:03.915968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510082f-1b1d-4c50-8547-11e2c30bd818 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:03.925886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 551/1100] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:25:03 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:25:03.932284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4fcce-e89e-46d9-8db5-f67b947319d2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:03.942221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4fcce-e89e-46d9-8db5-f67b947319d2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:03.947631 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a42a1-55c5-445f-9b9a-f39d65ecd69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:03.948439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a42a1-55c5-445f-9b9a-f39d65ecd69a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:03.948727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a42a1-55c5-445f-9b9a-f39d65ecd69a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:03.949001 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a42a1-55c5-445f-9b9a-f39d65ecd69a admin admin] PATH_INFO: `/v3/projects/7147b4d392a04e67b37e1623c5c91db7` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:03.950489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a42a1-55c5-445f-9b9a-f39d65ecd69a admin admin] RBAC: Authorizing `identity:get_project(project_id=7147b4d392a04e67b37e1623c5c91db7)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:03.976302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a42a1-55c5-445f-9b9a-f39d65ecd69a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:03.977923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 550/1101] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:25:03 2021] GET /identity/v3/projects/7147b4d392a04e67b37e1623c5c91db7 => generated 361 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:03.984558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510082f-1b1d-4c50-8547-11e2c30bd818 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:03.993601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510082f-1b1d-4c50-8547-11e2c30bd818 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:03.999366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74144f06-3f07-40a2-a006-9aca0e9a03ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:03.999961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74144f06-3f07-40a2-a006-9aca0e9a03ad admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:04.000243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74144f06-3f07-40a2-a006-9aca0e9a03ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:04.000521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74144f06-3f07-40a2-a006-9aca0e9a03ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:04.001312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74144f06-3f07-40a2-a006-9aca0e9a03ad admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=7147b4d392a04e67b37e1623c5c91db7, user.id=aa106fe70f4b458a98fa495801d65613) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:25:04.001620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74144f06-3f07-40a2-a006-9aca0e9a03ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:04.028462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74144f06-3f07-40a2-a006-9aca0e9a03ad admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:04.034927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 552/1102] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:25:03 2021] GET /identity/v3/role_assignments?user.id=aa106fe70f4b458a98fa495801d65613&scope.project.id=7147b4d392a04e67b37e1623c5c91db7&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:06.002027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef81fc-7064-4c95-9465-0b916bfc0fbf None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:06.002595 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef81fc-7064-4c95-9465-0b916bfc0fbf None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:06.002595 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef81fc-7064-4c95-9465-0b916bfc0fbf None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:06.004291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 551/1103] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:25:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:06.009783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e0c6e-cd08-409d-a51d-6d894b42023e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:06.010250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e0c6e-cd08-409d-a51d-6d894b42023e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:06.010342 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e0c6e-cd08-409d-a51d-6d894b42023e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:06.034740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-438e0c6e-cd08-409d-a51d-6d894b42023e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:06.035904 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-438e0c6e-cd08-409d-a51d-6d894b42023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:06.045503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 553/1104] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:06.068804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef81fc-7064-4c95-9465-0b916bfc0fbf None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:06.083261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef81fc-7064-4c95-9465-0b916bfc0fbf None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:06.088216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95258d3-d0bc-43e1-8e91-e012b5fa322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:06.088956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95258d3-d0bc-43e1-8e91-e012b5fa322d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:06.089249 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95258d3-d0bc-43e1-8e91-e012b5fa322d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:06.089526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95258d3-d0bc-43e1-8e91-e012b5fa322d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:06.101119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95258d3-d0bc-43e1-8e91-e012b5fa322d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:25:06.108181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-a95258d3-d0bc-43e1-8e91-e012b5fa322d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:25:06.109342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 552/1105] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:25:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:06.115800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e0c6e-cd08-409d-a51d-6d894b42023e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:06.125513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e0c6e-cd08-409d-a51d-6d894b42023e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:06.131042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e83369-bd2e-4ce2-a31a-e856eac8c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:06.131748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e83369-bd2e-4ce2-a31a-e856eac8c1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:06.132095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e83369-bd2e-4ce2-a31a-e856eac8c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:06.132430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e83369-bd2e-4ce2-a31a-e856eac8c1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:06.133213 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e83369-bd2e-4ce2-a31a-e856eac8c1f4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:25:06.133592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e83369-bd2e-4ce2-a31a-e856eac8c1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:06.159635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e83369-bd2e-4ce2-a31a-e856eac8c1f4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:06.169921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 554/1106] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:25:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:06.176647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95258d3-d0bc-43e1-8e91-e012b5fa322d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:06.193401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95258d3-d0bc-43e1-8e91-e012b5fa322d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:06.200308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f856c6-f08f-4be8-ba35-7309185a4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:06.201107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f856c6-f08f-4be8-ba35-7309185a4ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:06.201392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f856c6-f08f-4be8-ba35-7309185a4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:06.201670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f856c6-f08f-4be8-ba35-7309185a4ff0 admin admin] PATH_INFO: `/v3/users/aa106fe70f4b458a98fa495801d65613` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:06.202799 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f856c6-f08f-4be8-ba35-7309185a4ff0 admin admin] RBAC: Authorizing `identity:get_user(user_id=aa106fe70f4b458a98fa495801d65613)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:06.229061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f856c6-f08f-4be8-ba35-7309185a4ff0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:06.231226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 553/1107] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:25:06 2021] GET /identity/v3/users/aa106fe70f4b458a98fa495801d65613 => generated 311 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:25:06.236980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e83369-bd2e-4ce2-a31a-e856eac8c1f4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:06.246895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e83369-bd2e-4ce2-a31a-e856eac8c1f4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:06.251391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e396-06e7-4aa6-9b6c-5a347dd76334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:06.252258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e396-06e7-4aa6-9b6c-5a347dd76334 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:06.252478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e396-06e7-4aa6-9b6c-5a347dd76334 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:06.252756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e396-06e7-4aa6-9b6c-5a347dd76334 admin admin] PATH_INFO: `/v3/projects/7147b4d392a04e67b37e1623c5c91db7` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:06.253863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e396-06e7-4aa6-9b6c-5a347dd76334 admin admin] RBAC: Authorizing `identity:get_project(project_id=7147b4d392a04e67b37e1623c5c91db7)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:06.279721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e396-06e7-4aa6-9b6c-5a347dd76334 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:06.281408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 555/1108] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:25:06 2021] GET /identity/v3/projects/7147b4d392a04e67b37e1623c5c91db7 => generated 361 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:06.287768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f856c6-f08f-4be8-ba35-7309185a4ff0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:06.298210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f856c6-f08f-4be8-ba35-7309185a4ff0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:06.302623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8931c-7f2f-4f0e-9a9d-3046b3343c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:06.303437 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8931c-7f2f-4f0e-9a9d-3046b3343c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:06.303721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8931c-7f2f-4f0e-9a9d-3046b3343c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:06.303997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8931c-7f2f-4f0e-9a9d-3046b3343c3a admin admin] PATH_INFO: `/v3/projects/7147b4d392a04e67b37e1623c5c91db7/users/aa106fe70f4b458a98fa495801d65613/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:06.305847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8931c-7f2f-4f0e-9a9d-3046b3343c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7147b4d392a04e67b37e1623c5c91db7, user_id=aa106fe70f4b458a98fa495801d65613, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:06.332508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8931c-7f2f-4f0e-9a9d-3046b3343c3a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:06.349230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 554/1109] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:25:06 2021] PUT /identity/v3/projects/7147b4d392a04e67b37e1623c5c91db7/users/aa106fe70f4b458a98fa495801d65613/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:25:08.316858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692cd9c-76a2-4ef5-a2fd-374beefd7275 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.317445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692cd9c-76a2-4ef5-a2fd-374beefd7275 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.317445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692cd9c-76a2-4ef5-a2fd-374beefd7275 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.319250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 556/1110] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:25:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:25:08.326244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21508-036f-470d-bcef-c274199e14bc None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.326822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21508-036f-470d-bcef-c274199e14bc None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.326822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21508-036f-470d-bcef-c274199e14bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.356241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-84a21508-036f-470d-bcef-c274199e14bc None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:25:08.357451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-84a21508-036f-470d-bcef-c274199e14bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:25:08.443976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 555/1111] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:25:08 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:25:08.479871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692cd9c-76a2-4ef5-a2fd-374beefd7275 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.492407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692cd9c-76a2-4ef5-a2fd-374beefd7275 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.497259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48cdb-e90d-47a8-95dd-23703f7b6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.498354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48cdb-e90d-47a8-95dd-23703f7b6835 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.498544 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48cdb-e90d-47a8-95dd-23703f7b6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.498827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48cdb-e90d-47a8-95dd-23703f7b6835 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.515491 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b48cdb-e90d-47a8-95dd-23703f7b6835 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:25:08.525810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-b7b48cdb-e90d-47a8-95dd-23703f7b6835 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:25:08.527247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 557/1112] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:25:08.535221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a21508-036f-470d-bcef-c274199e14bc None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.549166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a21508-036f-470d-bcef-c274199e14bc None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.556209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde91a6-8656-4f0d-b002-7f90469f3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.556825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde91a6-8656-4f0d-b002-7f90469f3890 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.557085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde91a6-8656-4f0d-b002-7f90469f3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.557382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde91a6-8656-4f0d-b002-7f90469f3890 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.558140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde91a6-8656-4f0d-b002-7f90469f3890 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:25:08.558516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde91a6-8656-4f0d-b002-7f90469f3890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:08.585773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde91a6-8656-4f0d-b002-7f90469f3890 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.596407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 556/1113] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:08.603151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48cdb-e90d-47a8-95dd-23703f7b6835 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.613726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48cdb-e90d-47a8-95dd-23703f7b6835 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.619327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19044f57-939e-429b-a858-d1bcc9422a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.620146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19044f57-939e-429b-a858-d1bcc9422a81 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.620430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19044f57-939e-429b-a858-d1bcc9422a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.620713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19044f57-939e-429b-a858-d1bcc9422a81 admin admin] PATH_INFO: `/v3/users/aa106fe70f4b458a98fa495801d65613` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.622135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19044f57-939e-429b-a858-d1bcc9422a81 admin admin] RBAC: Authorizing `identity:get_user(user_id=aa106fe70f4b458a98fa495801d65613)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:08.648753 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19044f57-939e-429b-a858-d1bcc9422a81 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.650445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 558/1114] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/users/aa106fe70f4b458a98fa495801d65613 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:08.657243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde91a6-8656-4f0d-b002-7f90469f3890 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.668196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde91a6-8656-4f0d-b002-7f90469f3890 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.673653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd7fc-a489-4ea8-a507-512c3dc3085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.674280 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd7fc-a489-4ea8-a507-512c3dc3085c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.674570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd7fc-a489-4ea8-a507-512c3dc3085c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.674857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd7fc-a489-4ea8-a507-512c3dc3085c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.683832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd7fc-a489-4ea8-a507-512c3dc3085c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:08.714263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd7fc-a489-4ea8-a507-512c3dc3085c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.724789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 557/1115] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:25:08.731132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19044f57-939e-429b-a858-d1bcc9422a81 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.742036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19044f57-939e-429b-a858-d1bcc9422a81 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.747455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0e3f4-2aef-4549-9f22-29be9bc786ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.748924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0e3f4-2aef-4549-9f22-29be9bc786ee admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.749213 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0e3f4-2aef-4549-9f22-29be9bc786ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.749863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0e3f4-2aef-4549-9f22-29be9bc786ee admin admin] PATH_INFO: `/v3/projects/7147b4d392a04e67b37e1623c5c91db7` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.751082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0e3f4-2aef-4549-9f22-29be9bc786ee admin admin] RBAC: Authorizing `identity:get_project(project_id=7147b4d392a04e67b37e1623c5c91db7)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:08.784021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0e3f4-2aef-4549-9f22-29be9bc786ee admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.785789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 559/1116] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/projects/7147b4d392a04e67b37e1623c5c91db7 => generated 361 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:25:08.792670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd7fc-a489-4ea8-a507-512c3dc3085c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:25:08.804717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd7fc-a489-4ea8-a507-512c3dc3085c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:25:08.811051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420315f-c619-4ffd-96c7-11ab3e274eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:25:08.811647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420315f-c619-4ffd-96c7-11ab3e274eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:25:08.811984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420315f-c619-4ffd-96c7-11ab3e274eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:25:08.812207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420315f-c619-4ffd-96c7-11ab3e274eb2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:25:08.812997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420315f-c619-4ffd-96c7-11ab3e274eb2 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=7147b4d392a04e67b37e1623c5c91db7, user.id=aa106fe70f4b458a98fa495801d65613) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:25:08.813299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420315f-c619-4ffd-96c7-11ab3e274eb2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:25:08.839943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420315f-c619-4ffd-96c7-11ab3e274eb2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:25:08.847187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 558/1117] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:25:08 2021] GET /identity/v3/role_assignments?user.id=aa106fe70f4b458a98fa495801d65613&scope.project.id=7147b4d392a04e67b37e1623c5c91db7&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:41.743119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850d14-47f7-495d-ab92-8a3adc94d2fe None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:41.743766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850d14-47f7-495d-ab92-8a3adc94d2fe None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:41.743766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850d14-47f7-495d-ab92-8a3adc94d2fe None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:41.745349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 560/1118] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:26:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:41.750925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b365d83-18b4-4105-9be7-4d3207862608 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:41.751389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b365d83-18b4-4105-9be7-4d3207862608 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:41.751489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b365d83-18b4-4105-9be7-4d3207862608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:41.775296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2b365d83-18b4-4105-9be7-4d3207862608 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:41.776506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2b365d83-18b4-4105-9be7-4d3207862608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:41.784793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 559/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:41 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:41.808630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38850d14-47f7-495d-ab92-8a3adc94d2fe None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:41.822120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38850d14-47f7-495d-ab92-8a3adc94d2fe None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:41.827038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1a6ea-7983-4edd-a90f-271a22b4337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:41.827752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a6ea-7983-4edd-a90f-271a22b4337c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:41.828031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a6ea-7983-4edd-a90f-271a22b4337c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:41.828603 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a6ea-7983-4edd-a90f-271a22b4337c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:41.841013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1a6ea-7983-4edd-a90f-271a22b4337c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:41.866371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1a6ea-7983-4edd-a90f-271a22b4337c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:41.883464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-12d1a6ea-7983-4edd-a90f-271a22b4337c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:41.884572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 561/1120] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:41.890832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b365d83-18b4-4105-9be7-4d3207862608 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:41.900932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b365d83-18b4-4105-9be7-4d3207862608 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:41.905457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb096bba-86e6-4ede-9b72-e787e7695432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:41.906082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096bba-86e6-4ede-9b72-e787e7695432 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:41.906463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096bba-86e6-4ede-9b72-e787e7695432 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:41.906928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096bba-86e6-4ede-9b72-e787e7695432 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:41.907722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb096bba-86e6-4ede-9b72-e787e7695432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:41.908274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb096bba-86e6-4ede-9b72-e787e7695432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:41.936978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb096bba-86e6-4ede-9b72-e787e7695432 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:41.954722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 560/1121] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:41.961055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1a6ea-7983-4edd-a90f-271a22b4337c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:41.973606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1a6ea-7983-4edd-a90f-271a22b4337c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:41.978340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8ca54-1945-4e1b-98d1-e5ceb228c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:41.978956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8ca54-1945-4e1b-98d1-e5ceb228c4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:41.979235 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8ca54-1945-4e1b-98d1-e5ceb228c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:41.979508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8ca54-1945-4e1b-98d1-e5ceb228c4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:41.980157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8ca54-1945-4e1b-98d1-e5ceb228c4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:42.006224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8ca54-1945-4e1b-98d1-e5ceb228c4e4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:42.031015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 562/1122] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Dec 16 14:26:41 2021] POST /identity/v3/users => generated 251 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:26:44.065374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd72506-82ab-4349-91f3-5a0d5c497dcf None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.065971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd72506-82ab-4349-91f3-5a0d5c497dcf None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.065971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd72506-82ab-4349-91f3-5a0d5c497dcf None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.067644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 561/1123] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:26:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:44.073385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e5f01-a19b-4474-941e-fe479815ae5f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.073788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e5f01-a19b-4474-941e-fe479815ae5f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.073953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e5f01-a19b-4474-941e-fe479815ae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.098281 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a84e5f01-a19b-4474-941e-fe479815ae5f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:44.099448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a84e5f01-a19b-4474-941e-fe479815ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:44.107861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 563/1124] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:44 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:44.131908 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd72506-82ab-4349-91f3-5a0d5c497dcf None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.145912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd72506-82ab-4349-91f3-5a0d5c497dcf None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.150757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611609-97c3-4340-868d-68dc3e5ea674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.151527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611609-97c3-4340-868d-68dc3e5ea674 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.151813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611609-97c3-4340-868d-68dc3e5ea674 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.152088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611609-97c3-4340-868d-68dc3e5ea674 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.165555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48611609-97c3-4340-868d-68dc3e5ea674 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:26:44.172893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-48611609-97c3-4340-868d-68dc3e5ea674 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:26:44.174357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 562/1125] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:44.181107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e5f01-a19b-4474-941e-fe479815ae5f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.190782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e5f01-a19b-4474-941e-fe479815ae5f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.196545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81743d1c-0fb3-435f-a2ee-7b493ae87c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.197163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81743d1c-0fb3-435f-a2ee-7b493ae87c35 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.197448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81743d1c-0fb3-435f-a2ee-7b493ae87c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.197716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81743d1c-0fb3-435f-a2ee-7b493ae87c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.198493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81743d1c-0fb3-435f-a2ee-7b493ae87c35 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:44.198782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81743d1c-0fb3-435f-a2ee-7b493ae87c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.224703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81743d1c-0fb3-435f-a2ee-7b493ae87c35 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.234751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 564/1126] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:44.241120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611609-97c3-4340-868d-68dc3e5ea674 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.252167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611609-97c3-4340-868d-68dc3e5ea674 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.257501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4825e9-8acb-4cb9-a625-dde4bfc6e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.258304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4825e9-8acb-4cb9-a625-dde4bfc6e200 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.258586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4825e9-8acb-4cb9-a625-dde4bfc6e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.258862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4825e9-8acb-4cb9-a625-dde4bfc6e200 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.272177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4825e9-8acb-4cb9-a625-dde4bfc6e200 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.298544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4825e9-8acb-4cb9-a625-dde4bfc6e200 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.318458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-3c4825e9-8acb-4cb9-a625-dde4bfc6e200 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:44.319564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 563/1127] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:44.326233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81743d1c-0fb3-435f-a2ee-7b493ae87c35 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.336820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81743d1c-0fb3-435f-a2ee-7b493ae87c35 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.341739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b432e02-fff4-4a02-8f31-65dad85a1d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.342404 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b432e02-fff4-4a02-8f31-65dad85a1d30 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.342700 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b432e02-fff4-4a02-8f31-65dad85a1d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.342979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b432e02-fff4-4a02-8f31-65dad85a1d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.343691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b432e02-fff4-4a02-8f31-65dad85a1d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:44.344137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b432e02-fff4-4a02-8f31-65dad85a1d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.369755 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b432e02-fff4-4a02-8f31-65dad85a1d30 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.385337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 565/1128] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:44.391610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4825e9-8acb-4cb9-a625-dde4bfc6e200 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.401552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4825e9-8acb-4cb9-a625-dde4bfc6e200 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.406720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358384a4-b26c-486c-b321-6df9615a4e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.407379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358384a4-b26c-486c-b321-6df9615a4e7b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.407656 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358384a4-b26c-486c-b321-6df9615a4e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.407930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358384a4-b26c-486c-b321-6df9615a4e7b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.421554 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358384a4-b26c-486c-b321-6df9615a4e7b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.447375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358384a4-b26c-486c-b321-6df9615a4e7b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.466261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-358384a4-b26c-486c-b321-6df9615a4e7b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:26:44.467366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 564/1129] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/users/placement => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:44.473765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b432e02-fff4-4a02-8f31-65dad85a1d30 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.483952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b432e02-fff4-4a02-8f31-65dad85a1d30 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.489484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a6d30-7d2a-4e9e-ad8a-2917605cf90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.490123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a6d30-7d2a-4e9e-ad8a-2917605cf90e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.490406 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a6d30-7d2a-4e9e-ad8a-2917605cf90e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.490678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a6d30-7d2a-4e9e-ad8a-2917605cf90e admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.491475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a6d30-7d2a-4e9e-ad8a-2917605cf90e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:44.491769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a6d30-7d2a-4e9e-ad8a-2917605cf90e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.517189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a6d30-7d2a-4e9e-ad8a-2917605cf90e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.547367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 566/1130] 10.222.0.67 () {56 vars in 1164 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:44.553770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358384a4-b26c-486c-b321-6df9615a4e7b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.563764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358384a4-b26c-486c-b321-6df9615a4e7b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.568395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be2a52-8b7a-4309-8f88-b77505cec731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.569042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be2a52-8b7a-4309-8f88-b77505cec731 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.569266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be2a52-8b7a-4309-8f88-b77505cec731 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.569548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be2a52-8b7a-4309-8f88-b77505cec731 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.577654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be2a52-8b7a-4309-8f88-b77505cec731 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.603292 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be2a52-8b7a-4309-8f88-b77505cec731 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.613290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 565/1131] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:44.619726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a6d30-7d2a-4e9e-ad8a-2917605cf90e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.630103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a6d30-7d2a-4e9e-ad8a-2917605cf90e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.635682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3629e8-5a5f-43ce-9958-b70ea05ffdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.636409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3629e8-5a5f-43ce-9958-b70ea05ffdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.636693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3629e8-5a5f-43ce-9958-b70ea05ffdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.636964 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3629e8-5a5f-43ce-9958-b70ea05ffdf6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.649575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3629e8-5a5f-43ce-9958-b70ea05ffdf6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.675325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3629e8-5a5f-43ce-9958-b70ea05ffdf6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.692714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-2c3629e8-5a5f-43ce-9958-b70ea05ffdf6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:44.693819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 567/1132] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:44.700061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be2a52-8b7a-4309-8f88-b77505cec731 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.709169 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be2a52-8b7a-4309-8f88-b77505cec731 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.714706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4073-4b97-4b8e-af25-13578744a3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.715295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4073-4b97-4b8e-af25-13578744a3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.715578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4073-4b97-4b8e-af25-13578744a3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.715857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4073-4b97-4b8e-af25-13578744a3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.716549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4073-4b97-4b8e-af25-13578744a3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:44.716848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4073-4b97-4b8e-af25-13578744a3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.742714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4073-4b97-4b8e-af25-13578744a3c5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.756434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 566/1133] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:44.762713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3629e8-5a5f-43ce-9958-b70ea05ffdf6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.772957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3629e8-5a5f-43ce-9958-b70ea05ffdf6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.778384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63278335-713d-424d-af58-26d070c986a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.779107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63278335-713d-424d-af58-26d070c986a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.779381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63278335-713d-424d-af58-26d070c986a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.779653 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63278335-713d-424d-af58-26d070c986a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.790024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63278335-713d-424d-af58-26d070c986a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.816438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63278335-713d-424d-af58-26d070c986a0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.831290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-63278335-713d-424d-af58-26d070c986a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:44.832323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 568/1134] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:44.838783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4073-4b97-4b8e-af25-13578744a3c5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.848905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4073-4b97-4b8e-af25-13578744a3c5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.854293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92513f16-3f2c-4954-a6bc-fe41c79d62d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.854896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92513f16-3f2c-4954-a6bc-fe41c79d62d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.855153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92513f16-3f2c-4954-a6bc-fe41c79d62d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.855433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92513f16-3f2c-4954-a6bc-fe41c79d62d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.856189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92513f16-3f2c-4954-a6bc-fe41c79d62d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:44.856490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92513f16-3f2c-4954-a6bc-fe41c79d62d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.882220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92513f16-3f2c-4954-a6bc-fe41c79d62d0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.900191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 567/1135] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:44.907160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63278335-713d-424d-af58-26d070c986a0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:44.917900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63278335-713d-424d-af58-26d070c986a0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:44.923884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ed0e3-832e-4097-ab83-cb2bf9fb3088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:44.924482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ed0e3-832e-4097-ab83-cb2bf9fb3088 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:44.924766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ed0e3-832e-4097-ab83-cb2bf9fb3088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:44.925045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ed0e3-832e-4097-ab83-cb2bf9fb3088 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:44.925842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ed0e3-832e-4097-ab83-cb2bf9fb3088 admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=15e7b1dc56e949f2adb1744b492187a3) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:44.926187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ed0e3-832e-4097-ab83-cb2bf9fb3088 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:44.954820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ed0e3-832e-4097-ab83-cb2bf9fb3088 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:44.961616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 569/1136] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:44 2021] GET /identity/v3/role_assignments?user.id=15e7b1dc56e949f2adb1744b492187a3&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:46.916643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420aae5-f58c-4476-9ac1-03ead68547fd None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:46.917591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420aae5-f58c-4476-9ac1-03ead68547fd None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:46.917591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420aae5-f58c-4476-9ac1-03ead68547fd None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:46.919280 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 568/1137] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:26:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:46.924820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e476e0-cb3f-471c-909e-5056f71cba59 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:46.925296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e476e0-cb3f-471c-909e-5056f71cba59 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:46.925386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e476e0-cb3f-471c-909e-5056f71cba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:46.951022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-28e476e0-cb3f-471c-909e-5056f71cba59 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:46.952225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-28e476e0-cb3f-471c-909e-5056f71cba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:46.961657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 570/1138] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:46 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:46.984817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420aae5-f58c-4476-9ac1-03ead68547fd None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:46.997042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420aae5-f58c-4476-9ac1-03ead68547fd None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.001366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7479a1-dfd4-4036-9008-4b7e08cfc46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.002129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7479a1-dfd4-4036-9008-4b7e08cfc46b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.002413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7479a1-dfd4-4036-9008-4b7e08cfc46b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.002687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7479a1-dfd4-4036-9008-4b7e08cfc46b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.014640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7479a1-dfd4-4036-9008-4b7e08cfc46b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:26:47.021234 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-8f7479a1-dfd4-4036-9008-4b7e08cfc46b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:26:47.022429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 569/1139] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:26:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:47.028926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e476e0-cb3f-471c-909e-5056f71cba59 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.038103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e476e0-cb3f-471c-909e-5056f71cba59 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.043407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663bde4-a5f8-49bf-bb15-ce59e2c10a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.043998 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663bde4-a5f8-49bf-bb15-ce59e2c10a85 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.044276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663bde4-a5f8-49bf-bb15-ce59e2c10a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.044545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663bde4-a5f8-49bf-bb15-ce59e2c10a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.045255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663bde4-a5f8-49bf-bb15-ce59e2c10a85 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:47.045549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663bde4-a5f8-49bf-bb15-ce59e2c10a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.071034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663bde4-a5f8-49bf-bb15-ce59e2c10a85 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.080382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 571/1140] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:47.086425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7479a1-dfd4-4036-9008-4b7e08cfc46b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.096920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7479a1-dfd4-4036-9008-4b7e08cfc46b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.101368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af91cb-9729-407f-92dd-24793151d276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.102151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af91cb-9729-407f-92dd-24793151d276 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.102441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af91cb-9729-407f-92dd-24793151d276 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.102721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af91cb-9729-407f-92dd-24793151d276 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.114960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af91cb-9729-407f-92dd-24793151d276 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.140723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af91cb-9729-407f-92dd-24793151d276 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.160735 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-53af91cb-9729-407f-92dd-24793151d276 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:47.161954 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 570/1141] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:47.168532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663bde4-a5f8-49bf-bb15-ce59e2c10a85 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.178544 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663bde4-a5f8-49bf-bb15-ce59e2c10a85 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.183141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038ed2b-0eaf-4c9a-8b41-c914326b3432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.183726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038ed2b-0eaf-4c9a-8b41-c914326b3432 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.184008 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038ed2b-0eaf-4c9a-8b41-c914326b3432 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.184280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038ed2b-0eaf-4c9a-8b41-c914326b3432 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.184997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038ed2b-0eaf-4c9a-8b41-c914326b3432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:47.185287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038ed2b-0eaf-4c9a-8b41-c914326b3432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.210637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038ed2b-0eaf-4c9a-8b41-c914326b3432 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.224773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 572/1142] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:47.230870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af91cb-9729-407f-92dd-24793151d276 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.241430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af91cb-9729-407f-92dd-24793151d276 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.246614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3698c00-f856-4ddb-bc7f-cd54be286bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.247348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3698c00-f856-4ddb-bc7f-cd54be286bcd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.247626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3698c00-f856-4ddb-bc7f-cd54be286bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.247904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3698c00-f856-4ddb-bc7f-cd54be286bcd admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.261659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3698c00-f856-4ddb-bc7f-cd54be286bcd admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.288337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3698c00-f856-4ddb-bc7f-cd54be286bcd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.308312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-f3698c00-f856-4ddb-bc7f-cd54be286bcd admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:26:47.309492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 571/1143] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/users/placement => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:47.316309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038ed2b-0eaf-4c9a-8b41-c914326b3432 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.326926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038ed2b-0eaf-4c9a-8b41-c914326b3432 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.332977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddee412-16bb-45a1-96fb-c80864e2c870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.333604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddee412-16bb-45a1-96fb-c80864e2c870 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.333885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddee412-16bb-45a1-96fb-c80864e2c870 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.334217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddee412-16bb-45a1-96fb-c80864e2c870 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.335022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddee412-16bb-45a1-96fb-c80864e2c870 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:47.335365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddee412-16bb-45a1-96fb-c80864e2c870 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.361849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddee412-16bb-45a1-96fb-c80864e2c870 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.395572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 573/1144] 10.222.0.67 () {56 vars in 1164 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:47.401871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3698c00-f856-4ddb-bc7f-cd54be286bcd admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.412696 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3698c00-f856-4ddb-bc7f-cd54be286bcd admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.417944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2170119-8073-4ce0-9e7c-50cd9dc4a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.418787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2170119-8073-4ce0-9e7c-50cd9dc4a62d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.418928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2170119-8073-4ce0-9e7c-50cd9dc4a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.419233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2170119-8073-4ce0-9e7c-50cd9dc4a62d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.432938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2170119-8073-4ce0-9e7c-50cd9dc4a62d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.458906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2170119-8073-4ce0-9e7c-50cd9dc4a62d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.479044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-e2170119-8073-4ce0-9e7c-50cd9dc4a62d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:47.480340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 572/1145] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:47.487023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddee412-16bb-45a1-96fb-c80864e2c870 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.497722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddee412-16bb-45a1-96fb-c80864e2c870 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.503564 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d364ea-6c1a-4e3f-96bb-8b5995d3a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.504157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d364ea-6c1a-4e3f-96bb-8b5995d3a00c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.504466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d364ea-6c1a-4e3f-96bb-8b5995d3a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.504774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d364ea-6c1a-4e3f-96bb-8b5995d3a00c admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.505488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d364ea-6c1a-4e3f-96bb-8b5995d3a00c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:47.505790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d364ea-6c1a-4e3f-96bb-8b5995d3a00c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.531935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d364ea-6c1a-4e3f-96bb-8b5995d3a00c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.546488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 574/1146] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:47.552571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2170119-8073-4ce0-9e7c-50cd9dc4a62d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.562375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2170119-8073-4ce0-9e7c-50cd9dc4a62d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.567068 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815b25-e63f-4011-bb19-b942c8d5c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.567796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815b25-e63f-4011-bb19-b942c8d5c631 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.568078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815b25-e63f-4011-bb19-b942c8d5c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.568352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9815b25-e63f-4011-bb19-b942c8d5c631 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.577803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815b25-e63f-4011-bb19-b942c8d5c631 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.616415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9815b25-e63f-4011-bb19-b942c8d5c631 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.635559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-f9815b25-e63f-4011-bb19-b942c8d5c631 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:47.636813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 573/1147] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:47.644045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d364ea-6c1a-4e3f-96bb-8b5995d3a00c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.654826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d364ea-6c1a-4e3f-96bb-8b5995d3a00c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.660489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d52c8-f387-4728-84e1-60cdb2de7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.661110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d52c8-f387-4728-84e1-60cdb2de7110 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.661397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d52c8-f387-4728-84e1-60cdb2de7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.661675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d52c8-f387-4728-84e1-60cdb2de7110 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.662489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d52c8-f387-4728-84e1-60cdb2de7110 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:47.662790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d52c8-f387-4728-84e1-60cdb2de7110 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.689020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d52c8-f387-4728-84e1-60cdb2de7110 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.703928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 575/1148] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:47.710472 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815b25-e63f-4011-bb19-b942c8d5c631 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:47.720477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9815b25-e63f-4011-bb19-b942c8d5c631 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:47.725263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522be383-3184-4edc-a45d-a91989fd7a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:47.726156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522be383-3184-4edc-a45d-a91989fd7a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:47.726436 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522be383-3184-4edc-a45d-a91989fd7a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:47.726726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522be383-3184-4edc-a45d-a91989fd7a45 admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/15e7b1dc56e949f2adb1744b492187a3/roles/26d42daa051b453488fbaac4330bd6ab` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:47.751123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522be383-3184-4edc-a45d-a91989fd7a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=15e7b1dc56e949f2adb1744b492187a3, role_id=26d42daa051b453488fbaac4330bd6ab)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:47.778039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522be383-3184-4edc-a45d-a91989fd7a45 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:47.794747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 574/1149] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:26:47 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/15e7b1dc56e949f2adb1744b492187a3/roles/26d42daa051b453488fbaac4330bd6ab => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:26:49.823911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2005e-e199-430e-aecf-70578c143862 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:49.824549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2005e-e199-430e-aecf-70578c143862 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:49.824549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2005e-e199-430e-aecf-70578c143862 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:49.826180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 576/1150] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:26:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:49.832228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d5026-1bb7-4f8f-bc72-9bb9a3a3609a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:49.832804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d5026-1bb7-4f8f-bc72-9bb9a3a3609a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:49.832804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d5026-1bb7-4f8f-bc72-9bb9a3a3609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:49.860454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d02d5026-1bb7-4f8f-bc72-9bb9a3a3609a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:49.861644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d02d5026-1bb7-4f8f-bc72-9bb9a3a3609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:49.933528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 575/1151] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:49 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:49.957664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2005e-e199-430e-aecf-70578c143862 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:49.970515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2005e-e199-430e-aecf-70578c143862 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:49.975021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f3359-a0ca-4170-a8a6-681957e3ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:49.975748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f3359-a0ca-4170-a8a6-681957e3ba26 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:49.976030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f3359-a0ca-4170-a8a6-681957e3ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:49.976310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f3359-a0ca-4170-a8a6-681957e3ba26 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:49.988577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f3359-a0ca-4170-a8a6-681957e3ba26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:26:49.995161 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-632f3359-a0ca-4170-a8a6-681957e3ba26 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 16 14:26:49.996308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 577/1152] 10.222.0.67 () {56 vars in 1123 bytes} [Thu Dec 16 14:26:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:50.002729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d5026-1bb7-4f8f-bc72-9bb9a3a3609a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.011739 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d5026-1bb7-4f8f-bc72-9bb9a3a3609a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.017361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617949c-277e-42b6-bcf0-6121109971e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.017971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617949c-277e-42b6-bcf0-6121109971e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.018285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617949c-277e-42b6-bcf0-6121109971e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.018566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617949c-277e-42b6-bcf0-6121109971e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.019287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617949c-277e-42b6-bcf0-6121109971e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:50.019570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617949c-277e-42b6-bcf0-6121109971e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.045077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617949c-277e-42b6-bcf0-6121109971e0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.054498 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 576/1153] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:50.060575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f3359-a0ca-4170-a8a6-681957e3ba26 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.071368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f3359-a0ca-4170-a8a6-681957e3ba26 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.076827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb1d3f-d29f-4bc3-a550-feeecaabee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.077485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb1d3f-d29f-4bc3-a550-feeecaabee99 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.077763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb1d3f-d29f-4bc3-a550-feeecaabee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.078035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb1d3f-d29f-4bc3-a550-feeecaabee99 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.090767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb1d3f-d29f-4bc3-a550-feeecaabee99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.118248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb1d3f-d29f-4bc3-a550-feeecaabee99 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.139599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-47bb1d3f-d29f-4bc3-a550-feeecaabee99 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:50.140860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 578/1154] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:50.149882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617949c-277e-42b6-bcf0-6121109971e0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.160273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617949c-277e-42b6-bcf0-6121109971e0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.164858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796747ec-a395-4686-aa61-7dc977d755ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.165446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796747ec-a395-4686-aa61-7dc977d755ec admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.165726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796747ec-a395-4686-aa61-7dc977d755ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.166025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796747ec-a395-4686-aa61-7dc977d755ec admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.166724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796747ec-a395-4686-aa61-7dc977d755ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:50.166998 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796747ec-a395-4686-aa61-7dc977d755ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.192843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796747ec-a395-4686-aa61-7dc977d755ec admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.206672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 577/1155] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:26:50.213055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb1d3f-d29f-4bc3-a550-feeecaabee99 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.223338 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb1d3f-d29f-4bc3-a550-feeecaabee99 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.228810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2ccb-cf39-41f3-9e9b-45755863f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.229545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2ccb-cf39-41f3-9e9b-45755863f094 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.229798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2ccb-cf39-41f3-9e9b-45755863f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.230141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2ccb-cf39-41f3-9e9b-45755863f094 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.244210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe2ccb-cf39-41f3-9e9b-45755863f094 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.270019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe2ccb-cf39-41f3-9e9b-45755863f094 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.289949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-47fe2ccb-cf39-41f3-9e9b-45755863f094 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:26:50.291192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 579/1156] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/users/placement => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:50.298276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796747ec-a395-4686-aa61-7dc977d755ec admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.308719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796747ec-a395-4686-aa61-7dc977d755ec admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.314005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b9af5-a895-4ad3-86fe-ee181722c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.314666 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b9af5-a895-4ad3-86fe-ee181722c90e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.314950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b9af5-a895-4ad3-86fe-ee181722c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.315226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b9af5-a895-4ad3-86fe-ee181722c90e admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.316010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b9af5-a895-4ad3-86fe-ee181722c90e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:50.316320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b9af5-a895-4ad3-86fe-ee181722c90e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.342255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b9af5-a895-4ad3-86fe-ee181722c90e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.373539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 578/1157] 10.222.0.67 () {56 vars in 1164 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:50.380459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2ccb-cf39-41f3-9e9b-45755863f094 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.390811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2ccb-cf39-41f3-9e9b-45755863f094 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.396104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937ed3f-34cf-4d36-affc-9f599b4c1454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.396691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937ed3f-34cf-4d36-affc-9f599b4c1454 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.396968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937ed3f-34cf-4d36-affc-9f599b4c1454 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.397237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937ed3f-34cf-4d36-affc-9f599b4c1454 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.405945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937ed3f-34cf-4d36-affc-9f599b4c1454 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.434983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937ed3f-34cf-4d36-affc-9f599b4c1454 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.445877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 580/1158] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:50.452641 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b9af5-a895-4ad3-86fe-ee181722c90e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.463199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b9af5-a895-4ad3-86fe-ee181722c90e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.468591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a958b-e4ab-45b1-9718-69f9ed2eb7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.469923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a958b-e4ab-45b1-9718-69f9ed2eb7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.470238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a958b-e4ab-45b1-9718-69f9ed2eb7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.470518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a958b-e4ab-45b1-9718-69f9ed2eb7f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.483194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a958b-e4ab-45b1-9718-69f9ed2eb7f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.509063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a958b-e4ab-45b1-9718-69f9ed2eb7f3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.527172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-8b4a958b-e4ab-45b1-9718-69f9ed2eb7f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:50.528375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 579/1159] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:50.535670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937ed3f-34cf-4d36-affc-9f599b4c1454 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.545342 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937ed3f-34cf-4d36-affc-9f599b4c1454 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.550854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586c5d-b5cd-4b8d-9cd3-3bf7ee8f9ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.551528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586c5d-b5cd-4b8d-9cd3-3bf7ee8f9ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.551888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586c5d-b5cd-4b8d-9cd3-3bf7ee8f9ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.552189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586c5d-b5cd-4b8d-9cd3-3bf7ee8f9ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.552908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97586c5d-b5cd-4b8d-9cd3-3bf7ee8f9ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:50.553180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97586c5d-b5cd-4b8d-9cd3-3bf7ee8f9ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.578991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97586c5d-b5cd-4b8d-9cd3-3bf7ee8f9ad2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.593266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 581/1160] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:50.599659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a958b-e4ab-45b1-9718-69f9ed2eb7f3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.611118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a958b-e4ab-45b1-9718-69f9ed2eb7f3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.617020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12dec2-162f-4878-918a-77cbe35c0578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.617906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12dec2-162f-4878-918a-77cbe35c0578 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.618270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12dec2-162f-4878-918a-77cbe35c0578 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.618609 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12dec2-162f-4878-918a-77cbe35c0578 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.631656 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12dec2-162f-4878-918a-77cbe35c0578 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.664395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12dec2-162f-4878-918a-77cbe35c0578 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.680676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-ee12dec2-162f-4878-918a-77cbe35c0578 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:50.681862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 580/1161] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:50.688867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586c5d-b5cd-4b8d-9cd3-3bf7ee8f9ad2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.699359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586c5d-b5cd-4b8d-9cd3-3bf7ee8f9ad2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.703831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3413de1-e2dc-4756-8179-6f9d6eaef09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.704417 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3413de1-e2dc-4756-8179-6f9d6eaef09d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.704694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3413de1-e2dc-4756-8179-6f9d6eaef09d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.704967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3413de1-e2dc-4756-8179-6f9d6eaef09d admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.705705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3413de1-e2dc-4756-8179-6f9d6eaef09d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:50.706010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3413de1-e2dc-4756-8179-6f9d6eaef09d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.735260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3413de1-e2dc-4756-8179-6f9d6eaef09d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.753381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 582/1162] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:50.761515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12dec2-162f-4878-918a-77cbe35c0578 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:50.774037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12dec2-162f-4878-918a-77cbe35c0578 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:50.779312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e82292-1e4f-4afd-ab2b-4ec51af83de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:50.780011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e82292-1e4f-4afd-ab2b-4ec51af83de2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:50.780355 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e82292-1e4f-4afd-ab2b-4ec51af83de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:50.780689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e82292-1e4f-4afd-ab2b-4ec51af83de2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:50.781668 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e82292-1e4f-4afd-ab2b-4ec51af83de2 admin admin] RBAC: Adding query filter params (role.id=26d42daa051b453488fbaac4330bd6ab, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=15e7b1dc56e949f2adb1744b492187a3) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:50.782026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e82292-1e4f-4afd-ab2b-4ec51af83de2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:50.815431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e82292-1e4f-4afd-ab2b-4ec51af83de2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:50.823743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 581/1163] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:50 2021] GET /identity/v3/role_assignments?user.id=15e7b1dc56e949f2adb1744b492187a3&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=26d42daa051b453488fbaac4330bd6ab => generated 608 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:53.012961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be60b-6653-47b2-a878-de11cd445398 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.013575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be60b-6653-47b2-a878-de11cd445398 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.013575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be60b-6653-47b2-a878-de11cd445398 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.015320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 583/1164] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:26:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:53.021544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94e7b-b216-4c50-b919-ad3d9f585205 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.022092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94e7b-b216-4c50-b919-ad3d9f585205 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.022092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94e7b-b216-4c50-b919-ad3d9f585205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.047296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-25c94e7b-b216-4c50-b919-ad3d9f585205 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:53.048500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-25c94e7b-b216-4c50-b919-ad3d9f585205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:53.056464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 582/1165] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:53 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:53.079924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be60b-6653-47b2-a878-de11cd445398 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.094174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be60b-6653-47b2-a878-de11cd445398 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.101403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcdc29-2564-4c3e-943b-17fa012892b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.102207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcdc29-2564-4c3e-943b-17fa012892b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.102490 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcdc29-2564-4c3e-943b-17fa012892b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.102761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcdc29-2564-4c3e-943b-17fa012892b4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.117180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcdc29-2564-4c3e-943b-17fa012892b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:26:53.124336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-c9bcdc29-2564-4c3e-943b-17fa012892b4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:26:53.126061 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 584/1166] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:53.133815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94e7b-b216-4c50-b919-ad3d9f585205 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.145024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94e7b-b216-4c50-b919-ad3d9f585205 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.152892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d21df2-440c-40c7-9486-f1f4a8e25efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.153519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d21df2-440c-40c7-9486-f1f4a8e25efc admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.154394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d21df2-440c-40c7-9486-f1f4a8e25efc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.154394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d21df2-440c-40c7-9486-f1f4a8e25efc admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.154840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d21df2-440c-40c7-9486-f1f4a8e25efc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:53.155191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d21df2-440c-40c7-9486-f1f4a8e25efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.181361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d21df2-440c-40c7-9486-f1f4a8e25efc admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.191530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 583/1167] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:53.197621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcdc29-2564-4c3e-943b-17fa012892b4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.208221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcdc29-2564-4c3e-943b-17fa012892b4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.212543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adf827-09f5-4b36-ba89-49e87f4589d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.213269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adf827-09f5-4b36-ba89-49e87f4589d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.213551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adf827-09f5-4b36-ba89-49e87f4589d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.213826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adf827-09f5-4b36-ba89-49e87f4589d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.226045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adf827-09f5-4b36-ba89-49e87f4589d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.252401 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adf827-09f5-4b36-ba89-49e87f4589d6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.272143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-92adf827-09f5-4b36-ba89-49e87f4589d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:53.273248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 585/1168] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:53.279702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d21df2-440c-40c7-9486-f1f4a8e25efc admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.291925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d21df2-440c-40c7-9486-f1f4a8e25efc admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.297767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd398b0f-fb27-4554-8ac1-3f3dadb07756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.298639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd398b0f-fb27-4554-8ac1-3f3dadb07756 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.298925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd398b0f-fb27-4554-8ac1-3f3dadb07756 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.299204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd398b0f-fb27-4554-8ac1-3f3dadb07756 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.299930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd398b0f-fb27-4554-8ac1-3f3dadb07756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:53.300225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd398b0f-fb27-4554-8ac1-3f3dadb07756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.326250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd398b0f-fb27-4554-8ac1-3f3dadb07756 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.341426 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 584/1169] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:53.349098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adf827-09f5-4b36-ba89-49e87f4589d6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.359142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adf827-09f5-4b36-ba89-49e87f4589d6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.364402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac664-afb4-4ad3-8ae5-4c07fa85c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.365148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac664-afb4-4ad3-8ae5-4c07fa85c631 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.365459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac664-afb4-4ad3-8ae5-4c07fa85c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.365721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac664-afb4-4ad3-8ae5-4c07fa85c631 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.380627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ac664-afb4-4ad3-8ae5-4c07fa85c631 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.407667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ac664-afb4-4ad3-8ae5-4c07fa85c631 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.427961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-361ac664-afb4-4ad3-8ae5-4c07fa85c631 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:26:53.429136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 586/1170] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/users/placement => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:53.438122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd398b0f-fb27-4554-8ac1-3f3dadb07756 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.450912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd398b0f-fb27-4554-8ac1-3f3dadb07756 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.455735 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad62459-b19f-4ead-be17-bb2d7e9a79e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.456613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62459-b19f-4ead-be17-bb2d7e9a79e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.456995 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62459-b19f-4ead-be17-bb2d7e9a79e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.457288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62459-b19f-4ead-be17-bb2d7e9a79e5 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.458148 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad62459-b19f-4ead-be17-bb2d7e9a79e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:53.458456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad62459-b19f-4ead-be17-bb2d7e9a79e5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.484782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad62459-b19f-4ead-be17-bb2d7e9a79e5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.518254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 585/1171] 10.222.0.67 () {56 vars in 1164 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:53.524697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac664-afb4-4ad3-8ae5-4c07fa85c631 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.534712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac664-afb4-4ad3-8ae5-4c07fa85c631 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.539588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b495-ccbf-4ecf-a9a8-6bc34710437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.540179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b495-ccbf-4ecf-a9a8-6bc34710437d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.540458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b495-ccbf-4ecf-a9a8-6bc34710437d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.540730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b495-ccbf-4ecf-a9a8-6bc34710437d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.550019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7b495-ccbf-4ecf-a9a8-6bc34710437d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.575657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7b495-ccbf-4ecf-a9a8-6bc34710437d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.586525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 587/1172] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:53.592926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad62459-b19f-4ead-be17-bb2d7e9a79e5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.602751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad62459-b19f-4ead-be17-bb2d7e9a79e5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.607634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37f0e8-e7b7-4ed1-9206-34b3b08e6017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.608374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37f0e8-e7b7-4ed1-9206-34b3b08e6017 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.608654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37f0e8-e7b7-4ed1-9206-34b3b08e6017 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.608928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37f0e8-e7b7-4ed1-9206-34b3b08e6017 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.621913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37f0e8-e7b7-4ed1-9206-34b3b08e6017 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.648424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37f0e8-e7b7-4ed1-9206-34b3b08e6017 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.673968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-9c37f0e8-e7b7-4ed1-9206-34b3b08e6017 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:53.676302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 586/1173] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:53.683963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b495-ccbf-4ecf-a9a8-6bc34710437d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.693432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b495-ccbf-4ecf-a9a8-6bc34710437d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.698535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0d4fb-1ae0-4624-b92d-24e72e93eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.699125 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0d4fb-1ae0-4624-b92d-24e72e93eab5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.699404 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0d4fb-1ae0-4624-b92d-24e72e93eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.699672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0d4fb-1ae0-4624-b92d-24e72e93eab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.700356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0d4fb-1ae0-4624-b92d-24e72e93eab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:53.700647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0d4fb-1ae0-4624-b92d-24e72e93eab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.725943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0d4fb-1ae0-4624-b92d-24e72e93eab5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.743854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 588/1174] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:53.749834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37f0e8-e7b7-4ed1-9206-34b3b08e6017 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.762850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37f0e8-e7b7-4ed1-9206-34b3b08e6017 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.768835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ca7a8-d479-443f-aa52-2cadb699a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.769570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ca7a8-d479-443f-aa52-2cadb699a034 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.769860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ca7a8-d479-443f-aa52-2cadb699a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.770174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ca7a8-d479-443f-aa52-2cadb699a034 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.780175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ca7a8-d479-443f-aa52-2cadb699a034 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.806727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ca7a8-d479-443f-aa52-2cadb699a034 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.821817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-b63ca7a8-d479-443f-aa52-2cadb699a034 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:53.823199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 587/1175] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:53.830864 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0d4fb-1ae0-4624-b92d-24e72e93eab5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.841121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0d4fb-1ae0-4624-b92d-24e72e93eab5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.846926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042cb7f-30c7-4893-871a-3e533ce54966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.847512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042cb7f-30c7-4893-871a-3e533ce54966 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.847794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042cb7f-30c7-4893-871a-3e533ce54966 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.848054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042cb7f-30c7-4893-871a-3e533ce54966 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.848780 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042cb7f-30c7-4893-871a-3e533ce54966 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:53.849074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042cb7f-30c7-4893-871a-3e533ce54966 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.875040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042cb7f-30c7-4893-871a-3e533ce54966 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.889818 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 589/1176] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:53.896373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ca7a8-d479-443f-aa52-2cadb699a034 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:53.906207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ca7a8-d479-443f-aa52-2cadb699a034 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:53.911982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6dc48-ddff-4e96-ac7c-eccdbbfb5397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:53.912597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6dc48-ddff-4e96-ac7c-eccdbbfb5397 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:53.912890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6dc48-ddff-4e96-ac7c-eccdbbfb5397 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:53.913140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6dc48-ddff-4e96-ac7c-eccdbbfb5397 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:53.913920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6dc48-ddff-4e96-ac7c-eccdbbfb5397 admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=15e7b1dc56e949f2adb1744b492187a3) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:53.914247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6dc48-ddff-4e96-ac7c-eccdbbfb5397 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:53.941541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6dc48-ddff-4e96-ac7c-eccdbbfb5397 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:53.947859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 588/1177] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:53 2021] GET /identity/v3/role_assignments?user.id=15e7b1dc56e949f2adb1744b492187a3&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:55.934183 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1538d-5df7-46af-a538-f0e2e90b6055 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:55.934746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1538d-5df7-46af-a538-f0e2e90b6055 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:55.934746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1538d-5df7-46af-a538-f0e2e90b6055 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:55.936398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 590/1178] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:26:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:55.942329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5087cd-377e-4a29-9592-709ced12cedd None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:55.942786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5087cd-377e-4a29-9592-709ced12cedd None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:55.942875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5087cd-377e-4a29-9592-709ced12cedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:55.967069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-ac5087cd-377e-4a29-9592-709ced12cedd None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:55.968239 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ac5087cd-377e-4a29-9592-709ced12cedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:55.976555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 589/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:55 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:55.998892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1538d-5df7-46af-a538-f0e2e90b6055 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.012290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1538d-5df7-46af-a538-f0e2e90b6055 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.016679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05292596-1fbd-4145-84f3-52f2a181bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.017397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05292596-1fbd-4145-84f3-52f2a181bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.017677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05292596-1fbd-4145-84f3-52f2a181bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.017949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05292596-1fbd-4145-84f3-52f2a181bed0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.029283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05292596-1fbd-4145-84f3-52f2a181bed0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:26:56.035812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-05292596-1fbd-4145-84f3-52f2a181bed0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:26:56.037248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 591/1180] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:56.044114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5087cd-377e-4a29-9592-709ced12cedd None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.053379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5087cd-377e-4a29-9592-709ced12cedd None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.058804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df04a6-2158-46b6-872d-9f31f70c8bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.059400 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df04a6-2158-46b6-872d-9f31f70c8bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.059676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df04a6-2158-46b6-872d-9f31f70c8bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.059948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df04a6-2158-46b6-872d-9f31f70c8bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.060664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df04a6-2158-46b6-872d-9f31f70c8bb9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:56.060963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df04a6-2158-46b6-872d-9f31f70c8bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.086540 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df04a6-2158-46b6-872d-9f31f70c8bb9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.096161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 590/1181] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:26:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:56.102046 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05292596-1fbd-4145-84f3-52f2a181bed0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.112239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05292596-1fbd-4145-84f3-52f2a181bed0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.117593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd4e83-9a84-4076-8bfc-a04d612d126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.118774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4e83-9a84-4076-8bfc-a04d612d126a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.118774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4e83-9a84-4076-8bfc-a04d612d126a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.119012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4e83-9a84-4076-8bfc-a04d612d126a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.131129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd4e83-9a84-4076-8bfc-a04d612d126a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.156613 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd4e83-9a84-4076-8bfc-a04d612d126a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.177564 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-74cd4e83-9a84-4076-8bfc-a04d612d126a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:56.178715 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 592/1182] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:56.184993 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df04a6-2158-46b6-872d-9f31f70c8bb9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.195131 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df04a6-2158-46b6-872d-9f31f70c8bb9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.200167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674251d2-f09a-4316-97dd-c197eba3b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.200768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674251d2-f09a-4316-97dd-c197eba3b9fa admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.201054 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674251d2-f09a-4316-97dd-c197eba3b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.201345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674251d2-f09a-4316-97dd-c197eba3b9fa admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.202046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674251d2-f09a-4316-97dd-c197eba3b9fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:56.202374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674251d2-f09a-4316-97dd-c197eba3b9fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.228016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674251d2-f09a-4316-97dd-c197eba3b9fa admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.245571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 591/1183] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:56.252123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd4e83-9a84-4076-8bfc-a04d612d126a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.261752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd4e83-9a84-4076-8bfc-a04d612d126a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.266137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fb934-8cae-4987-bad6-c15ed24adfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.267064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fb934-8cae-4987-bad6-c15ed24adfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.267345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fb934-8cae-4987-bad6-c15ed24adfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.267618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fb934-8cae-4987-bad6-c15ed24adfa5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.281521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fb934-8cae-4987-bad6-c15ed24adfa5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.307972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fb934-8cae-4987-bad6-c15ed24adfa5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.327447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-8a9fb934-8cae-4987-bad6-c15ed24adfa5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:26:56.328669 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 593/1184] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:56 2021] GET /identity/v3/users/placement => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:56.335116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674251d2-f09a-4316-97dd-c197eba3b9fa admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.346541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674251d2-f09a-4316-97dd-c197eba3b9fa admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.351938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f239c-6dff-41ff-a891-ec6f0f321113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.352571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f239c-6dff-41ff-a891-ec6f0f321113 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.352863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f239c-6dff-41ff-a891-ec6f0f321113 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.353145 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f239c-6dff-41ff-a891-ec6f0f321113 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.354014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f239c-6dff-41ff-a891-ec6f0f321113 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:56.354330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f239c-6dff-41ff-a891-ec6f0f321113 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.380517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f239c-6dff-41ff-a891-ec6f0f321113 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.410697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 592/1185] 10.222.0.67 () {56 vars in 1164 bytes} [Thu Dec 16 14:26:56 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:56.416801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fb934-8cae-4987-bad6-c15ed24adfa5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.427433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fb934-8cae-4987-bad6-c15ed24adfa5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.432561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e0ea8-c045-4b36-bc71-77a8d2647f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.433283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e0ea8-c045-4b36-bc71-77a8d2647f80 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.433562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e0ea8-c045-4b36-bc71-77a8d2647f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.433828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e0ea8-c045-4b36-bc71-77a8d2647f80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.447478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e0ea8-c045-4b36-bc71-77a8d2647f80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.473322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e0ea8-c045-4b36-bc71-77a8d2647f80 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.491699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-607e0ea8-c045-4b36-bc71-77a8d2647f80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:56.493052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 594/1186] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:56.499182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f239c-6dff-41ff-a891-ec6f0f321113 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.509415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f239c-6dff-41ff-a891-ec6f0f321113 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.514429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b28e72-0a16-4e9d-8a3e-e43d79e0005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.515035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b28e72-0a16-4e9d-8a3e-e43d79e0005a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.515328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b28e72-0a16-4e9d-8a3e-e43d79e0005a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.515617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b28e72-0a16-4e9d-8a3e-e43d79e0005a admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.516632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b28e72-0a16-4e9d-8a3e-e43d79e0005a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:56.517099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b28e72-0a16-4e9d-8a3e-e43d79e0005a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.543278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b28e72-0a16-4e9d-8a3e-e43d79e0005a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.557312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 593/1187] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:56.563472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e0ea8-c045-4b36-bc71-77a8d2647f80 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.573667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e0ea8-c045-4b36-bc71-77a8d2647f80 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.578737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7488c87-587d-4800-835f-4bfb864e49ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.579582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488c87-587d-4800-835f-4bfb864e49ad admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.579859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488c87-587d-4800-835f-4bfb864e49ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.580110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488c87-587d-4800-835f-4bfb864e49ad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.590460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488c87-587d-4800-835f-4bfb864e49ad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.616295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488c87-587d-4800-835f-4bfb864e49ad admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.631175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-a7488c87-587d-4800-835f-4bfb864e49ad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:56.632298 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 595/1188] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:56.638655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b28e72-0a16-4e9d-8a3e-e43d79e0005a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.648967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b28e72-0a16-4e9d-8a3e-e43d79e0005a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.654017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d63e9-316d-49b3-ba93-6ab19f92e292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.654640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d63e9-316d-49b3-ba93-6ab19f92e292 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.654929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d63e9-316d-49b3-ba93-6ab19f92e292 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.655211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d63e9-316d-49b3-ba93-6ab19f92e292 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.656000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d63e9-316d-49b3-ba93-6ab19f92e292 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:56.656323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d63e9-316d-49b3-ba93-6ab19f92e292 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.684671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d63e9-316d-49b3-ba93-6ab19f92e292 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.699594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 594/1189] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:56.706075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7488c87-587d-4800-835f-4bfb864e49ad admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:56.715869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7488c87-587d-4800-835f-4bfb864e49ad admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:56.720618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800ea8-d881-4097-9078-89c9f2dd0f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:56.721441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800ea8-d881-4097-9078-89c9f2dd0f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:56.721727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800ea8-d881-4097-9078-89c9f2dd0f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:56.722031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800ea8-d881-4097-9078-89c9f2dd0f7e admin admin] PATH_INFO: `/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/15e7b1dc56e949f2adb1744b492187a3/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:56.723888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01800ea8-d881-4097-9078-89c9f2dd0f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d18cf4033c4cf3992edc7b1939b8d5, user_id=15e7b1dc56e949f2adb1744b492187a3, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:56.750766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01800ea8-d881-4097-9078-89c9f2dd0f7e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:56.766323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 596/1190] 10.222.0.67 () {58 vars in 1460 bytes} [Thu Dec 16 14:26:56 2021] PUT /identity/v3/projects/b6d18cf4033c4cf3992edc7b1939b8d5/users/15e7b1dc56e949f2adb1744b492187a3/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:26:58.791390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4e761-f43d-4879-916b-01bbc3a0301d None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:58.791969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4e761-f43d-4879-916b-01bbc3a0301d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:58.791969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4e761-f43d-4879-916b-01bbc3a0301d None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:58.794017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 595/1191] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:26:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:26:58.799632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d368f0-cf31-414f-8e32-f98e369244a2 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:58.800088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d368f0-cf31-414f-8e32-f98e369244a2 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:58.800186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d368f0-cf31-414f-8e32-f98e369244a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:58.824153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-56d368f0-cf31-414f-8e32-f98e369244a2 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:26:58.825393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-56d368f0-cf31-414f-8e32-f98e369244a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:26:58.894314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 597/1192] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:26:58 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:26:58.918261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4e761-f43d-4879-916b-01bbc3a0301d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:58.932057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4e761-f43d-4879-916b-01bbc3a0301d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:58.936649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76513b84-a4c8-43e8-aa9c-a4fa4ff3aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:58.937384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76513b84-a4c8-43e8-aa9c-a4fa4ff3aa3b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:58.937677 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76513b84-a4c8-43e8-aa9c-a4fa4ff3aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:58.937943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76513b84-a4c8-43e8-aa9c-a4fa4ff3aa3b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:58.949671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76513b84-a4c8-43e8-aa9c-a4fa4ff3aa3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Dec 16 14:26:58.956266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-76513b84-a4c8-43e8-aa9c-a4fa4ff3aa3b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 16 14:26:58.957376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 596/1193] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Dec 16 14:26:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:58.963861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d368f0-cf31-414f-8e32-f98e369244a2 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:58.972957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d368f0-cf31-414f-8e32-f98e369244a2 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:58.978380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a9e03-518d-4033-b713-b2018cd1f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:58.978986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a9e03-518d-4033-b713-b2018cd1f196 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:58.979593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a9e03-518d-4033-b713-b2018cd1f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:58.979974 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a9e03-518d-4033-b713-b2018cd1f196 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:58.980724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a9e03-518d-4033-b713-b2018cd1f196 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:58.981018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a9e03-518d-4033-b713-b2018cd1f196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.006848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a9e03-518d-4033-b713-b2018cd1f196 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.016101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 598/1194] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Dec 16 14:26:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:59.022317 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76513b84-a4c8-43e8-aa9c-a4fa4ff3aa3b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.033503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76513b84-a4c8-43e8-aa9c-a4fa4ff3aa3b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.038444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc4d98-1f47-4d94-a90b-f6c1860d360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.039187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc4d98-1f47-4d94-a90b-f6c1860d360a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.039470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc4d98-1f47-4d94-a90b-f6c1860d360a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.039746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc4d98-1f47-4d94-a90b-f6c1860d360a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.052369 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc4d98-1f47-4d94-a90b-f6c1860d360a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.078796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc4d98-1f47-4d94-a90b-f6c1860d360a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.098969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-73fc4d98-1f47-4d94-a90b-f6c1860d360a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:59.100357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 597/1195] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:59.106246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a9e03-518d-4033-b713-b2018cd1f196 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.116332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a9e03-518d-4033-b713-b2018cd1f196 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.121397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fa0f3-3cf5-4a01-8799-4f8cf87558ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.122016 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa0f3-3cf5-4a01-8799-4f8cf87558ad admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.122314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa0f3-3cf5-4a01-8799-4f8cf87558ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.122586 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa0f3-3cf5-4a01-8799-4f8cf87558ad admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.123269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa0f3-3cf5-4a01-8799-4f8cf87558ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:59.123567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa0f3-3cf5-4a01-8799-4f8cf87558ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.149309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa0f3-3cf5-4a01-8799-4f8cf87558ad admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.163253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 599/1196] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:59.169693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc4d98-1f47-4d94-a90b-f6c1860d360a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.180338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc4d98-1f47-4d94-a90b-f6c1860d360a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.185820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244b61-35ce-4d5e-bafc-66167f2b8966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.186598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244b61-35ce-4d5e-bafc-66167f2b8966 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.186880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244b61-35ce-4d5e-bafc-66167f2b8966 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.187152 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244b61-35ce-4d5e-bafc-66167f2b8966 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.201870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f244b61-35ce-4d5e-bafc-66167f2b8966 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.228825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f244b61-35ce-4d5e-bafc-66167f2b8966 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.248389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-9f244b61-35ce-4d5e-bafc-66167f2b8966 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 16 14:26:59.249526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 598/1197] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/users/placement => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:59.256240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fa0f3-3cf5-4a01-8799-4f8cf87558ad admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.266177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fa0f3-3cf5-4a01-8799-4f8cf87558ad admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.271728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8f070-04f9-4000-a904-b52f6873faf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.272321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8f070-04f9-4000-a904-b52f6873faf7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.272601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8f070-04f9-4000-a904-b52f6873faf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.272872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8f070-04f9-4000-a904-b52f6873faf7 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.273660 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8f070-04f9-4000-a904-b52f6873faf7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:59.273963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8f070-04f9-4000-a904-b52f6873faf7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.300215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8f070-04f9-4000-a904-b52f6873faf7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.330806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 600/1198] 10.222.0.67 () {56 vars in 1164 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:59.336828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244b61-35ce-4d5e-bafc-66167f2b8966 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.346846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244b61-35ce-4d5e-bafc-66167f2b8966 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.351249 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cc0be-45e7-47e6-a70f-9b9c5d23abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.351831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cc0be-45e7-47e6-a70f-9b9c5d23abba admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.352110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cc0be-45e7-47e6-a70f-9b9c5d23abba admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.352393 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cc0be-45e7-47e6-a70f-9b9c5d23abba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.360734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cc0be-45e7-47e6-a70f-9b9c5d23abba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.386463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cc0be-45e7-47e6-a70f-9b9c5d23abba admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.398133 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 599/1199] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:26:59.404339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8f070-04f9-4000-a904-b52f6873faf7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.414249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8f070-04f9-4000-a904-b52f6873faf7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.419586 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f67bb-8f5b-4e61-a723-a135109aadfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.420310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f67bb-8f5b-4e61-a723-a135109aadfe admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.420624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f67bb-8f5b-4e61-a723-a135109aadfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.420897 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f67bb-8f5b-4e61-a723-a135109aadfe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.433836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f67bb-8f5b-4e61-a723-a135109aadfe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.459555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f67bb-8f5b-4e61-a723-a135109aadfe admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.478351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-111f67bb-8f5b-4e61-a723-a135109aadfe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 16 14:26:59.479527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 601/1200] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 16 14:26:59.485874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cc0be-45e7-47e6-a70f-9b9c5d23abba admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.494988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cc0be-45e7-47e6-a70f-9b9c5d23abba admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.500552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd394-04cb-4e44-85b8-59221b7daedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.501245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd394-04cb-4e44-85b8-59221b7daedc admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.501531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd394-04cb-4e44-85b8-59221b7daedc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.501809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd394-04cb-4e44-85b8-59221b7daedc admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.502551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd394-04cb-4e44-85b8-59221b7daedc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:59.502856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd394-04cb-4e44-85b8-59221b7daedc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.528501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd394-04cb-4e44-85b8-59221b7daedc admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.542930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 600/1201] 10.222.0.67 () {56 vars in 1130 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:59.548903 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f67bb-8f5b-4e61-a723-a135109aadfe admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.558942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f67bb-8f5b-4e61-a723-a135109aadfe admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.564420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c447d3-604d-439b-9e51-596dafd2a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.565152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c447d3-604d-439b-9e51-596dafd2a472 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.565428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c447d3-604d-439b-9e51-596dafd2a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.565695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c447d3-604d-439b-9e51-596dafd2a472 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.576156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c447d3-604d-439b-9e51-596dafd2a472 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.602752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c447d3-604d-439b-9e51-596dafd2a472 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.618449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING keystone.server.flask.application [None req-88c447d3-604d-439b-9e51-596dafd2a472 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 16 14:26:59.619596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 602/1202] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:26:59.626764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd394-04cb-4e44-85b8-59221b7daedc admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.636878 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd394-04cb-4e44-85b8-59221b7daedc admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.641311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59c7e6-027a-4b5e-8453-dcd3451794fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.642512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59c7e6-027a-4b5e-8453-dcd3451794fb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.642794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59c7e6-027a-4b5e-8453-dcd3451794fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.643068 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59c7e6-027a-4b5e-8453-dcd3451794fb admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.643823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59c7e6-027a-4b5e-8453-dcd3451794fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:59.644125 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59c7e6-027a-4b5e-8453-dcd3451794fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.670596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59c7e6-027a-4b5e-8453-dcd3451794fb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.685482 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 601/1203] 10.222.0.67 () {56 vars in 1169 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:26:59.692083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c447d3-604d-439b-9e51-596dafd2a472 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:26:59.702207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c447d3-604d-439b-9e51-596dafd2a472 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:26:59.707257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42e72b-b2c8-424a-822a-6e8188f8283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:26:59.707879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42e72b-b2c8-424a-822a-6e8188f8283d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:26:59.708166 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42e72b-b2c8-424a-822a-6e8188f8283d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:26:59.708442 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42e72b-b2c8-424a-822a-6e8188f8283d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:26:59.709321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42e72b-b2c8-424a-822a-6e8188f8283d admin admin] RBAC: Adding query filter params (role.id=df1ba7f919104bd2849e19b7d341df4d, scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5, user.id=15e7b1dc56e949f2adb1744b492187a3) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:26:59.709638 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42e72b-b2c8-424a-822a-6e8188f8283d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:26:59.739180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42e72b-b2c8-424a-822a-6e8188f8283d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:26:59.746210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 603/1204] 10.222.0.67 () {56 vars in 1395 bytes} [Thu Dec 16 14:26:59 2021] GET /identity/v3/role_assignments?user.id=15e7b1dc56e949f2adb1744b492187a3&scope.project.id=b6d18cf4033c4cf3992edc7b1939b8d5&role.id=df1ba7f919104bd2849e19b7d341df4d => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:01.788872 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bdc2c-1f43-4c02-b612-fed77c33b7e9 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:01.789465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bdc2c-1f43-4c02-b612-fed77c33b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:01.789465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bdc2c-1f43-4c02-b612-fed77c33b7e9 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:01.791202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 602/1205] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:27:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:01.797124 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1d089-6e0c-4593-abcf-9e373f9705db None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:01.797653 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1d089-6e0c-4593-abcf-9e373f9705db None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:01.797653 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1d089-6e0c-4593-abcf-9e373f9705db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:01.823844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-7af1d089-6e0c-4593-abcf-9e373f9705db None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:01.825031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7af1d089-6e0c-4593-abcf-9e373f9705db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:01.833852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 604/1206] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:01.856780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bdc2c-1f43-4c02-b612-fed77c33b7e9 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:01.869854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bdc2c-1f43-4c02-b612-fed77c33b7e9 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:01.874019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c3a6-b6c6-4f85-aa3e-668e314d4cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:01.874790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c3a6-b6c6-4f85-aa3e-668e314d4cdb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:01.875084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c3a6-b6c6-4f85-aa3e-668e314d4cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:01.875372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c3a6-b6c6-4f85-aa3e-668e314d4cdb admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:01.876140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940c3a6-b6c6-4f85-aa3e-668e314d4cdb admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:01.901757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940c3a6-b6c6-4f85-aa3e-668e314d4cdb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:01.913690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-1940c3a6-b6c6-4f85-aa3e-668e314d4cdb admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 16 14:27:01.914854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 603/1207] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:27:01 2021] GET /identity/v3/services/placement => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:27:01.921576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1d089-6e0c-4593-abcf-9e373f9705db None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:01.930703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1d089-6e0c-4593-abcf-9e373f9705db None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:01.935288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aa9db-87a6-400f-ab2b-f08d29a4f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:01.935891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa9db-87a6-400f-ab2b-f08d29a4f82d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:01.936175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa9db-87a6-400f-ab2b-f08d29a4f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:01.936413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa9db-87a6-400f-ab2b-f08d29a4f82d admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:01.937146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aa9db-87a6-400f-ab2b-f08d29a4f82d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:27:01.937445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aa9db-87a6-400f-ab2b-f08d29a4f82d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:01.963202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aa9db-87a6-400f-ab2b-f08d29a4f82d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:01.968762 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 605/1208] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Dec 16 14:27:01 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:01.975215 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c3a6-b6c6-4f85-aa3e-668e314d4cdb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:01.988156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c3a6-b6c6-4f85-aa3e-668e314d4cdb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:01.993431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22953981-9798-464b-ae2f-1a31b545e6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:01.994038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953981-9798-464b-ae2f-1a31b545e6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:01.994352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953981-9798-464b-ae2f-1a31b545e6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:01.994603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953981-9798-464b-ae2f-1a31b545e6c7 admin admin] PATH_INFO: `/v3/services` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:01.995312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953981-9798-464b-ae2f-1a31b545e6c7 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:27:01.995608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953981-9798-464b-ae2f-1a31b545e6c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:02.021332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953981-9798-464b-ae2f-1a31b545e6c7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:02.026588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 604/1209] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Dec 16 14:27:01 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:04.091003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980efce-082e-492e-b5af-ef4cfe4b5204 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:04.091805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980efce-082e-492e-b5af-ef4cfe4b5204 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:04.091921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980efce-082e-492e-b5af-ef4cfe4b5204 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:04.094661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 606/1210] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:27:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:04.100872 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94014-2bb2-485d-98a2-d2ccc6050856 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:04.101612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94014-2bb2-485d-98a2-d2ccc6050856 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:04.101612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94014-2bb2-485d-98a2-d2ccc6050856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:04.126311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-36d94014-2bb2-485d-98a2-d2ccc6050856 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:04.127481 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-36d94014-2bb2-485d-98a2-d2ccc6050856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:04.135164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 605/1211] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:04.158890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980efce-082e-492e-b5af-ef4cfe4b5204 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:04.172613 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980efce-082e-492e-b5af-ef4cfe4b5204 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:04.177106 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a9b41-d8cd-4c7a-8229-97074dcc8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:04.177725 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a9b41-d8cd-4c7a-8229-97074dcc8499 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:04.178020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a9b41-d8cd-4c7a-8229-97074dcc8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:04.178313 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a9b41-d8cd-4c7a-8229-97074dcc8499 admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:04.179000 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a9b41-d8cd-4c7a-8229-97074dcc8499 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:04.204376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a9b41-d8cd-4c7a-8229-97074dcc8499 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:04.220626 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 607/1212] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Dec 16 14:27:04 2021] POST /identity/v3/services => generated 246 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:27:06.256840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e289b7-fd2e-4c6d-a3c5-dd67a88e6c7f None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.257432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e289b7-fd2e-4c6d-a3c5-dd67a88e6c7f None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.257432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e289b7-fd2e-4c6d-a3c5-dd67a88e6c7f None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.259098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 606/1213] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:27:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:06.264864 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93fcaf-386d-4c6b-aec7-ca31e0f2c0e8 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.265321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93fcaf-386d-4c6b-aec7-ca31e0f2c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.265410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93fcaf-386d-4c6b-aec7-ca31e0f2c0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.290127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-da93fcaf-386d-4c6b-aec7-ca31e0f2c0e8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:06.291403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-da93fcaf-386d-4c6b-aec7-ca31e0f2c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:06.312266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 608/1214] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:06 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:06.335352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e289b7-fd2e-4c6d-a3c5-dd67a88e6c7f None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.348781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e289b7-fd2e-4c6d-a3c5-dd67a88e6c7f None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.353391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651b5b-53ad-41ed-aaea-f4bcd945c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.354161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651b5b-53ad-41ed-aaea-f4bcd945c551 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.354445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651b5b-53ad-41ed-aaea-f4bcd945c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.354719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651b5b-53ad-41ed-aaea-f4bcd945c551 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.355340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6651b5b-53ad-41ed-aaea-f4bcd945c551 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:06.381017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6651b5b-53ad-41ed-aaea-f4bcd945c551 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:06.392734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-f6651b5b-53ad-41ed-aaea-f4bcd945c551 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 16 14:27:06.393809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 607/1215] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/services/placement => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:27:06.400465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93fcaf-386d-4c6b-aec7-ca31e0f2c0e8 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.409689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93fcaf-386d-4c6b-aec7-ca31e0f2c0e8 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.414141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f25471-0c73-4f1a-b510-5cb8c9e560be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.414749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f25471-0c73-4f1a-b510-5cb8c9e560be admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.415033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f25471-0c73-4f1a-b510-5cb8c9e560be admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.415308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f25471-0c73-4f1a-b510-5cb8c9e560be admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.415993 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f25471-0c73-4f1a-b510-5cb8c9e560be admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:27:06.416285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f25471-0c73-4f1a-b510-5cb8c9e560be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:06.442249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f25471-0c73-4f1a-b510-5cb8c9e560be admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:06.448545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 609/1216] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:06.455272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651b5b-53ad-41ed-aaea-f4bcd945c551 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.465806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651b5b-53ad-41ed-aaea-f4bcd945c551 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.471062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b83a2-826d-4658-9bf3-b88fdb99d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.471659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b83a2-826d-4658-9bf3-b88fdb99d2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.471944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b83a2-826d-4658-9bf3-b88fdb99d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.472227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b83a2-826d-4658-9bf3-b88fdb99d2a5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.472993 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b83a2-826d-4658-9bf3-b88fdb99d2a5 admin admin] RBAC: Adding query filter params (interface=public, service_id=e891d13a37154a75b430741877341406, region_id=RegionOne) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:27:06.473305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b83a2-826d-4658-9bf3-b88fdb99d2a5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:06.499177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b83a2-826d-4658-9bf3-b88fdb99d2a5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:06.505475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 608/1217] 10.222.0.67 () {56 vars in 1272 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/endpoints?service_id=e891d13a37154a75b430741877341406&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:06.511604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f25471-0c73-4f1a-b510-5cb8c9e560be admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:06.522447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f25471-0c73-4f1a-b510-5cb8c9e560be admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:06.527707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2e95d-45db-40df-8e91-e5c1dbc592af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:06.528311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2e95d-45db-40df-8e91-e5c1dbc592af admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:06.528595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2e95d-45db-40df-8e91-e5c1dbc592af admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:06.528897 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2e95d-45db-40df-8e91-e5c1dbc592af admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:06.529588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2e95d-45db-40df-8e91-e5c1dbc592af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:06.555873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2e95d-45db-40df-8e91-e5c1dbc592af admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:06.564312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 610/1218] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:27:06 2021] GET /identity/v3/services => generated 2430 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:27:08.702557 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a1d8-3ddc-49ef-8a84-a133a85cf4eb None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.703167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a1d8-3ddc-49ef-8a84-a133a85cf4eb None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.703167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a1d8-3ddc-49ef-8a84-a133a85cf4eb None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.704895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 609/1219] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:27:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:27:08.710781 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4bb2a-531d-4719-ae22-9b014f27857c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.711558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4bb2a-531d-4719-ae22-9b014f27857c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.711558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4bb2a-531d-4719-ae22-9b014f27857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.736179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-29e4bb2a-531d-4719-ae22-9b014f27857c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:27:08.737355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-29e4bb2a-531d-4719-ae22-9b014f27857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:27:08.745553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 611/1220] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:27:08 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:27:08.770980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0a1d8-3ddc-49ef-8a84-a133a85cf4eb None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:08.785478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0a1d8-3ddc-49ef-8a84-a133a85cf4eb None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:08.789586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabc75c-662a-4e9d-b6a9-446db510b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:08.790363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabc75c-662a-4e9d-b6a9-446db510b1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.790646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabc75c-662a-4e9d-b6a9-446db510b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.790925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabc75c-662a-4e9d-b6a9-446db510b1f6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.791560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabc75c-662a-4e9d-b6a9-446db510b1f6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:08.818954 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabc75c-662a-4e9d-b6a9-446db510b1f6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:08.831403 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING keystone.server.flask.application [None req-4aabc75c-662a-4e9d-b6a9-446db510b1f6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 16 14:27:08.832599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 610/1221] 10.222.0.67 () {56 vars in 1138 bytes} [Thu Dec 16 14:27:08 2021] GET /identity/v3/services/placement => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 16 14:27:08.842956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4bb2a-531d-4719-ae22-9b014f27857c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:08.856143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4bb2a-531d-4719-ae22-9b014f27857c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:08.863332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84fb3e-8e4d-46c4-9f29-6de61481db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:08.864077 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84fb3e-8e4d-46c4-9f29-6de61481db1e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.864352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84fb3e-8e4d-46c4-9f29-6de61481db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.864624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84fb3e-8e4d-46c4-9f29-6de61481db1e admin admin] PATH_INFO: `/v3/services` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.865403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84fb3e-8e4d-46c4-9f29-6de61481db1e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:27:08.865672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84fb3e-8e4d-46c4-9f29-6de61481db1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:08.893774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84fb3e-8e4d-46c4-9f29-6de61481db1e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:08.900639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 612/1222] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Dec 16 14:27:08 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:27:08.907514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabc75c-662a-4e9d-b6a9-446db510b1f6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:27:08.920045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabc75c-662a-4e9d-b6a9-446db510b1f6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:27:08.924893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba359bd8-f53a-4c2d-8c83-c3331204d0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:27:08.925490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba359bd8-f53a-4c2d-8c83-c3331204d0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:27:08.925766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba359bd8-f53a-4c2d-8c83-c3331204d0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:27:08.926083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba359bd8-f53a-4c2d-8c83-c3331204d0d5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:27:08.926803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba359bd8-f53a-4c2d-8c83-c3331204d0d5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:27:08.952502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba359bd8-f53a-4c2d-8c83-c3331204d0d5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:27:08.975643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 611/1223] 10.222.0.67 () {60 vars in 1165 bytes} [Thu Dec 16 14:27:08 2021] POST /identity/v3/endpoints => generated 331 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:29:02.946445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87029acc-947e-4b62-8038-4cd760510238 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:02.947074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87029acc-947e-4b62-8038-4cd760510238 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:02.947074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87029acc-947e-4b62-8038-4cd760510238 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:02.949002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 613/1224] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:02.957241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9053573-b60b-4e87-b9b4-46429f70d6df None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:02.957800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9053573-b60b-4e87-b9b4-46429f70d6df None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:02.957800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9053573-b60b-4e87-b9b4-46429f70d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:03.079000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e9053573-b60b-4e87-b9b4-46429f70d6df None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:03.080237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e9053573-b60b-4e87-b9b4-46429f70d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:03.244981 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 612/1225] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:29:03.274601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87029acc-947e-4b62-8038-4cd760510238 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:03.276311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-87029acc-947e-4b62-8038-4cd760510238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:03.491273 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87029acc-947e-4b62-8038-4cd760510238 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:03.630478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a97a84-e8a5-47b4-874b-cce3e1f5bb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:03.631272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97a84-e8a5-47b4-874b-cce3e1f5bb0e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:03.631561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97a84-e8a5-47b4-874b-cce3e1f5bb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:03.632006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97a84-e8a5-47b4-874b-cce3e1f5bb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:03.633249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a97a84-e8a5-47b4-874b-cce3e1f5bb0e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:03.670150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a97a84-e8a5-47b4-874b-cce3e1f5bb0e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:03.692429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 614/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:29:03 2021] GET /identity/v3/projects => generated 2553 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:29:05.896884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bb25-04f0-40e0-8c6e-fe03fe2f3549 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:05.897518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bb25-04f0-40e0-8c6e-fe03fe2f3549 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:05.897518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bb25-04f0-40e0-8c6e-fe03fe2f3549 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:05.899177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 613/1227] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:05.904676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0915a8-285d-405e-9bf3-4239ac96b4cb None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:05.905165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0915a8-285d-405e-9bf3-4239ac96b4cb None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:05.905287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0915a8-285d-405e-9bf3-4239ac96b4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.003629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-9c0915a8-285d-405e-9bf3-4239ac96b4cb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:06.004875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9c0915a8-285d-405e-9bf3-4239ac96b4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:06.154056 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 615/1228] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:06.220671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4030-52a9-400c-912f-b907e9b612d5 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:06.221131 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4030-52a9-400c-912f-b907e9b612d5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:06.221411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4030-52a9-400c-912f-b907e9b612d5 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.223327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 614/1229] 10.222.0.67 () {54 vars in 963 bytes} [Thu Dec 16 14:29:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:06.233329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a6745-0537-4ba0-8fc5-19b28e4bb6a4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:06.233713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a6745-0537-4ba0-8fc5-19b28e4bb6a4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:06.234113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a6745-0537-4ba0-8fc5-19b28e4bb6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.342933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-7e3a6745-0537-4ba0-8fc5-19b28e4bb6a4 None None] MFA Rules not processed for user `20905ef1afa847bc8f2f6f6e335f8bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:06.344143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7e3a6745-0537-4ba0-8fc5-19b28e4bb6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:06.433750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 616/1230] 10.222.0.67 () {58 vars in 1060 bytes} [Thu Dec 16 14:29:06 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:06.443171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf4030-52a9-400c-912f-b907e9b612d5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:06.444887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a1cf4030-52a9-400c-912f-b907e9b612d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:06.576263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf4030-52a9-400c-912f-b907e9b612d5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:06.671156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e0bd-d858-4376-9e47-2165d738e183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:06.671919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e0bd-d858-4376-9e47-2165d738e183 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:06.672541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e0bd-d858-4376-9e47-2165d738e183 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:06.672770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e0bd-d858-4376-9e47-2165d738e183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:06.675171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-fe45e0bd-d858-4376-9e47-2165d738e183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:06.808898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e0bd-d858-4376-9e47-2165d738e183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:06.834442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e0bd-d858-4376-9e47-2165d738e183 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:06.856670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 615/1231] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:09.165858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880322da-8e56-4709-a73e-ea091880ebef None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.166425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880322da-8e56-4709-a73e-ea091880ebef None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.166540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880322da-8e56-4709-a73e-ea091880ebef None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.168249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 617/1232] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:09.174378 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e7857-524e-4b96-a84a-773f99a9b802 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.175190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e7857-524e-4b96-a84a-773f99a9b802 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.175190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e7857-524e-4b96-a84a-773f99a9b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.328753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-5f3e7857-524e-4b96-a84a-773f99a9b802 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:09.330811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5f3e7857-524e-4b96-a84a-773f99a9b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:09.527661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 616/1233] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:09.582105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ee423-3f5c-400c-bee4-88e43cbdb24e None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.582467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ee423-3f5c-400c-bee4-88e43cbdb24e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.582754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ee423-3f5c-400c-bee4-88e43cbdb24e None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.584980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 618/1234] 10.222.0.67 () {54 vars in 963 bytes} [Thu Dec 16 14:29:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:09.592862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb724cb-fd07-4afb-af4c-bbcf4d769908 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:09.593185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb724cb-fd07-4afb-af4c-bbcf4d769908 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:09.593471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb724cb-fd07-4afb-af4c-bbcf4d769908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:09.725618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2eb724cb-fd07-4afb-af4c-bbcf4d769908 None None] MFA Rules not processed for user `20905ef1afa847bc8f2f6f6e335f8bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:09.726801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2eb724cb-fd07-4afb-af4c-bbcf4d769908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:09.818923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 617/1235] 10.222.0.67 () {58 vars in 1060 bytes} [Thu Dec 16 14:29:09 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:09.828679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ee423-3f5c-400c-bee4-88e43cbdb24e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:09.830683 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-204ee423-3f5c-400c-bee4-88e43cbdb24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:09.967205 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ee423-3f5c-400c-bee4-88e43cbdb24e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:10.057689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015dab4-6fe7-4c47-a707-2f6671aa7529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:10.058308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015dab4-6fe7-4c47-a707-2f6671aa7529 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:10.058592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015dab4-6fe7-4c47-a707-2f6671aa7529 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:10.058866 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015dab4-6fe7-4c47-a707-2f6671aa7529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:10.060416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8015dab4-6fe7-4c47-a707-2f6671aa7529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:10.228984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015dab4-6fe7-4c47-a707-2f6671aa7529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:10.255861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015dab4-6fe7-4c47-a707-2f6671aa7529 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:10.280609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 619/1236] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:13.144695 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d780b7-1cbb-410e-8609-666053a3246e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:13.145243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d780b7-1cbb-410e-8609-666053a3246e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:13.145243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d780b7-1cbb-410e-8609-666053a3246e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:13.147059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 618/1237] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:13.152863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb213-b6bb-4b5b-b8d8-3a3d71707a65 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:13.153327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb213-b6bb-4b5b-b8d8-3a3d71707a65 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:13.153450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb213-b6bb-4b5b-b8d8-3a3d71707a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:13.270571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d00cb213-b6bb-4b5b-b8d8-3a3d71707a65 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:13.271764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d00cb213-b6bb-4b5b-b8d8-3a3d71707a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:13.396688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 620/1238] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:13.431184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d780b7-1cbb-410e-8609-666053a3246e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:13.432856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-41d780b7-1cbb-410e-8609-666053a3246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:13.591941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d780b7-1cbb-410e-8609-666053a3246e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:13.713225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb56517-5a5a-4078-908d-c17ea47a1363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:13.713936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb56517-5a5a-4078-908d-c17ea47a1363 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:13.714254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb56517-5a5a-4078-908d-c17ea47a1363 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:13.714542 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb56517-5a5a-4078-908d-c17ea47a1363 admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:13.727948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb56517-5a5a-4078-908d-c17ea47a1363 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:13.754924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb56517-5a5a-4078-908d-c17ea47a1363 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:13.756959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 619/1239] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:29:13 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:13.773124 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb213-b6bb-4b5b-b8d8-3a3d71707a65 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:13.774693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d00cb213-b6bb-4b5b-b8d8-3a3d71707a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:13.902575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb213-b6bb-4b5b-b8d8-3a3d71707a65 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:13.990184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04cc21-6833-42ea-8bdc-d80d05251658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:13.990697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04cc21-6833-42ea-8bdc-d80d05251658 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:13.990985 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04cc21-6833-42ea-8bdc-d80d05251658 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:13.991259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04cc21-6833-42ea-8bdc-d80d05251658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:13.992805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2c04cc21-6833-42ea-8bdc-d80d05251658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:14.122248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04cc21-6833-42ea-8bdc-d80d05251658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:14.147762 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04cc21-6833-42ea-8bdc-d80d05251658 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:14.170010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 621/1240] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:16.998441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4ef4-3e16-4798-b079-43f99bd77573 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:16.999005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4ef4-3e16-4798-b079-43f99bd77573 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:16.999005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4ef4-3e16-4798-b079-43f99bd77573 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.000660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 620/1241] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:17.007089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551aa61-b172-4dae-8f2c-6ad37878e67c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.007553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551aa61-b172-4dae-8f2c-6ad37878e67c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.007662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551aa61-b172-4dae-8f2c-6ad37878e67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.106176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d551aa61-b172-4dae-8f2c-6ad37878e67c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:17.107366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d551aa61-b172-4dae-8f2c-6ad37878e67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:17.247045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 622/1242] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:17.282053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc4ef4-3e16-4798-b079-43f99bd77573 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.283451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-38bc4ef4-3e16-4798-b079-43f99bd77573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:17.462398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc4ef4-3e16-4798-b079-43f99bd77573 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.595964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb35b5b-1182-407c-a567-e570f63cdd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.596765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb35b5b-1182-407c-a567-e570f63cdd1b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.597714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb35b5b-1182-407c-a567-e570f63cdd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.598109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb35b5b-1182-407c-a567-e570f63cdd1b admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.615055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb35b5b-1182-407c-a567-e570f63cdd1b admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:17.642251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb35b5b-1182-407c-a567-e570f63cdd1b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:17.644859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 621/1243] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:17.657752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551aa61-b172-4dae-8f2c-6ad37878e67c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:17.658952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d551aa61-b172-4dae-8f2c-6ad37878e67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:17.786111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551aa61-b172-4dae-8f2c-6ad37878e67c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:17.886339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8ce93-26c9-4fc6-a508-111ec1b85744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:17.886948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8ce93-26c9-4fc6-a508-111ec1b85744 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:17.887210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8ce93-26c9-4fc6-a508-111ec1b85744 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:17.887521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8ce93-26c9-4fc6-a508-111ec1b85744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:17.889100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a2b8ce93-26c9-4fc6-a508-111ec1b85744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:18.035473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8ce93-26c9-4fc6-a508-111ec1b85744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:18.062953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8ce93-26c9-4fc6-a508-111ec1b85744 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:18.086116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 623/1244] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:21.171448 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3670613-c3ed-4422-b686-56278b887d63 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:21.172027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3670613-c3ed-4422-b686-56278b887d63 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:21.172027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3670613-c3ed-4422-b686-56278b887d63 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:21.173729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 622/1245] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:21.179905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79af4f-b30c-435c-acb3-5a7ece4b3255 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:21.180398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79af4f-b30c-435c-acb3-5a7ece4b3255 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:21.180513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79af4f-b30c-435c-acb3-5a7ece4b3255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:21.271295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6d79af4f-b30c-435c-acb3-5a7ece4b3255 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:21.272520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6d79af4f-b30c-435c-acb3-5a7ece4b3255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:21.403990 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 624/1246] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:21.441318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3670613-c3ed-4422-b686-56278b887d63 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:21.442814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c3670613-c3ed-4422-b686-56278b887d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:21.567081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3670613-c3ed-4422-b686-56278b887d63 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:21.656565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612e17a-fdc0-483d-840c-652d50722617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:21.657074 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612e17a-fdc0-483d-840c-652d50722617 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:21.657377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612e17a-fdc0-483d-840c-652d50722617 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:21.657649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612e17a-fdc0-483d-840c-652d50722617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:21.659229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8612e17a-fdc0-483d-840c-652d50722617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:21.796002 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612e17a-fdc0-483d-840c-652d50722617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:21.821407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612e17a-fdc0-483d-840c-652d50722617 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:21.844920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 623/1247] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:23.948777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6cc08-d471-4281-8f85-38c3df05edc2 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:23.949356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6cc08-d471-4281-8f85-38c3df05edc2 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:23.949356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6cc08-d471-4281-8f85-38c3df05edc2 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:23.951139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 625/1248] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:23.956852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352c55d-fdd6-42d1-bd19-1ca0fc6ce1f6 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:23.957329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352c55d-fdd6-42d1-bd19-1ca0fc6ce1f6 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:23.957434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352c55d-fdd6-42d1-bd19-1ca0fc6ce1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:24.055546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-1352c55d-fdd6-42d1-bd19-1ca0fc6ce1f6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:24.056703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1352c55d-fdd6-42d1-bd19-1ca0fc6ce1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:24.184926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 624/1249] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:24.221619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6cc08-d471-4281-8f85-38c3df05edc2 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:24.223239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1be6cc08-d471-4281-8f85-38c3df05edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:24.357907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6cc08-d471-4281-8f85-38c3df05edc2 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:24.465060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd9fc2-7ef8-4f2e-8758-dff72e311b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:24.465678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd9fc2-7ef8-4f2e-8758-dff72e311b2c service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:24.465957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd9fc2-7ef8-4f2e-8758-dff72e311b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:24.466265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd9fc2-7ef8-4f2e-8758-dff72e311b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:24.467861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-dddd9fc2-7ef8-4f2e-8758-dff72e311b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:24.613422 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd9fc2-7ef8-4f2e-8758-dff72e311b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:24.638960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd9fc2-7ef8-4f2e-8758-dff72e311b2c service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:24.662286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 626/1250] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:26.797157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366e17-c90a-4cf9-b59e-97749555639e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:26.797722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366e17-c90a-4cf9-b59e-97749555639e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:26.797722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366e17-c90a-4cf9-b59e-97749555639e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:26.799457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 625/1251] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:26.805831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcbc69-45f2-4fe8-b0ea-beeed3f99ce4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:26.806463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcbc69-45f2-4fe8-b0ea-beeed3f99ce4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:26.806463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcbc69-45f2-4fe8-b0ea-beeed3f99ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:26.905750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1ddcbc69-45f2-4fe8-b0ea-beeed3f99ce4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:26.906991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1ddcbc69-45f2-4fe8-b0ea-beeed3f99ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:27.024116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 627/1252] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:27.056326 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366e17-c90a-4cf9-b59e-97749555639e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:27.057789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f3366e17-c90a-4cf9-b59e-97749555639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:27.203404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366e17-c90a-4cf9-b59e-97749555639e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:27.314712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bc3f0-5440-4eb7-a416-7fe7ebcd61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:27.315668 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bc3f0-5440-4eb7-a416-7fe7ebcd61bd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:27.316099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bc3f0-5440-4eb7-a416-7fe7ebcd61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:27.316383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bc3f0-5440-4eb7-a416-7fe7ebcd61bd admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:27.332683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bc3f0-5440-4eb7-a416-7fe7ebcd61bd admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:27.362382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bc3f0-5440-4eb7-a416-7fe7ebcd61bd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:27.364558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 626/1253] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:29:27 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:29:27.379965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcbc69-45f2-4fe8-b0ea-beeed3f99ce4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:27.381372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1ddcbc69-45f2-4fe8-b0ea-beeed3f99ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:27.504855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcbc69-45f2-4fe8-b0ea-beeed3f99ce4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:27.681480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6b29c-4bfa-4a37-881c-cec1e6a34f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:27.682110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6b29c-4bfa-4a37-881c-cec1e6a34f3d service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:27.682389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6b29c-4bfa-4a37-881c-cec1e6a34f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:27.682660 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6b29c-4bfa-4a37-881c-cec1e6a34f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:27.684187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e0a6b29c-4bfa-4a37-881c-cec1e6a34f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:27.818749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6b29c-4bfa-4a37-881c-cec1e6a34f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:27.846917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6b29c-4bfa-4a37-881c-cec1e6a34f3d service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:27.869505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 628/1254] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:30.189817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9fc2c-3d01-4eb1-b984-054f89cbbc0b None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:30.190626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9fc2c-3d01-4eb1-b984-054f89cbbc0b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:30.190626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9fc2c-3d01-4eb1-b984-054f89cbbc0b None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:30.192264 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 627/1255] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:30.198939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975870b-d316-488f-997f-f4592884e07e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:30.199637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975870b-d316-488f-997f-f4592884e07e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:30.199637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975870b-d316-488f-997f-f4592884e07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:30.300718 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1975870b-d316-488f-997f-f4592884e07e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:30.301925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1975870b-d316-488f-997f-f4592884e07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:30.428487 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 629/1256] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:29:30.466077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9fc2c-3d01-4eb1-b984-054f89cbbc0b None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:30.467824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a1b9fc2c-3d01-4eb1-b984-054f89cbbc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:30.618052 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9fc2c-3d01-4eb1-b984-054f89cbbc0b None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:30.710338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3655f-d0b2-42cd-8673-3d3cbb427c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:30.710839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3655f-d0b2-42cd-8673-3d3cbb427c4c service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:30.711130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3655f-d0b2-42cd-8673-3d3cbb427c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:30.711411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3655f-d0b2-42cd-8673-3d3cbb427c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:30.712987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f2c3655f-d0b2-42cd-8673-3d3cbb427c4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:30.854233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3655f-d0b2-42cd-8673-3d3cbb427c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:30.881209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3655f-d0b2-42cd-8673-3d3cbb427c4c service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:30.906088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 628/1257] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:33.018837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53204f0-be89-41ba-935c-e5aba84a0755 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:33.019425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53204f0-be89-41ba-935c-e5aba84a0755 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:33.019425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53204f0-be89-41ba-935c-e5aba84a0755 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:33.021243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 630/1258] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:33.027036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dbe0d-5ae2-492a-b315-dfbb3b0420ed None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:33.027563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dbe0d-5ae2-492a-b315-dfbb3b0420ed None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:33.027563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dbe0d-5ae2-492a-b315-dfbb3b0420ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:33.211404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-fd0dbe0d-5ae2-492a-b315-dfbb3b0420ed None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:33.212569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-fd0dbe0d-5ae2-492a-b315-dfbb3b0420ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:33.348262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 629/1259] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:33.388841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53204f0-be89-41ba-935c-e5aba84a0755 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:33.391129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e53204f0-be89-41ba-935c-e5aba84a0755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:33.527524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53204f0-be89-41ba-935c-e5aba84a0755 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:33.531732 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9190a-d331-4b4b-b334-06c0aa509f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:33.532327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9190a-d331-4b4b-b334-06c0aa509f57 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:33.532628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9190a-d331-4b4b-b334-06c0aa509f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:33.532912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9190a-d331-4b4b-b334-06c0aa509f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:33.543782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9190a-d331-4b4b-b334-06c0aa509f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:33.569783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9190a-d331-4b4b-b334-06c0aa509f57 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:33.580246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 631/1260] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:36.036700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dea856-d897-48d5-b822-e3b4260e5d06 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:36.037284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dea856-d897-48d5-b822-e3b4260e5d06 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:36.037284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dea856-d897-48d5-b822-e3b4260e5d06 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:36.039081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 630/1261] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:36.045011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3128026-6e58-434f-8a60-87e1868837aa None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:36.045478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3128026-6e58-434f-8a60-87e1868837aa None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:36.045581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3128026-6e58-434f-8a60-87e1868837aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:36.069960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-e3128026-6e58-434f-8a60-87e1868837aa None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:36.071155 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e3128026-6e58-434f-8a60-87e1868837aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:36.079756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 632/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:36.116247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dea856-d897-48d5-b822-e3b4260e5d06 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:36.130710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dea856-d897-48d5-b822-e3b4260e5d06 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:36.135682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aa97b-4c9d-4699-b33d-c5c46de4bdc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:36.136278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa97b-4c9d-4699-b33d-c5c46de4bdc7 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:36.136565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa97b-4c9d-4699-b33d-c5c46de4bdc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:36.136812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa97b-4c9d-4699-b33d-c5c46de4bdc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:36.147585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aa97b-4c9d-4699-b33d-c5c46de4bdc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:36.173206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aa97b-4c9d-4699-b33d-c5c46de4bdc7 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:36.185585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 631/1263] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:40.760479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca552a9-dae6-48b9-b26f-e6adc7fae283 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:40.761018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca552a9-dae6-48b9-b26f-e6adc7fae283 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:40.761142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca552a9-dae6-48b9-b26f-e6adc7fae283 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:40.762960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 633/1264] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:40.768497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a2ae-bedb-489f-9ffa-fc0f43cf5c5d None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:40.769033 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a2ae-bedb-489f-9ffa-fc0f43cf5c5d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:40.769190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a2ae-bedb-489f-9ffa-fc0f43cf5c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:40.796221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c104a2ae-bedb-489f-9ffa-fc0f43cf5c5d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:40.797700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c104a2ae-bedb-489f-9ffa-fc0f43cf5c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:40.806625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 632/1265] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:40.845920 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca552a9-dae6-48b9-b26f-e6adc7fae283 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:40.847533 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0ca552a9-dae6-48b9-b26f-e6adc7fae283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:40.859997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca552a9-dae6-48b9-b26f-e6adc7fae283 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:40.863357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c327b8e-68e5-4c27-a520-b7566737aa65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:40.864018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327b8e-68e5-4c27-a520-b7566737aa65 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:40.864297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327b8e-68e5-4c27-a520-b7566737aa65 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:40.864625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327b8e-68e5-4c27-a520-b7566737aa65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:40.873327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c327b8e-68e5-4c27-a520-b7566737aa65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:40.900089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c327b8e-68e5-4c27-a520-b7566737aa65 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:40.910854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 634/1266] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:43.791499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c368b-c430-4c64-8f34-87844c798f3b None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:43.792086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c368b-c430-4c64-8f34-87844c798f3b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:43.792086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c368b-c430-4c64-8f34-87844c798f3b None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:43.793768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 633/1267] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:43.800414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6e916-5d18-4780-813b-585b021a3d4e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:43.801629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6e916-5d18-4780-813b-585b021a3d4e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:43.801629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6e916-5d18-4780-813b-585b021a3d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:43.825233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-01b6e916-5d18-4780-813b-585b021a3d4e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:43.826455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-01b6e916-5d18-4780-813b-585b021a3d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:43.834205 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 635/1268] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:43.872047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c368b-c430-4c64-8f34-87844c798f3b None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:43.883219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c368b-c430-4c64-8f34-87844c798f3b None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:43.886471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a52d66-7843-4a2f-80b0-38904ad255a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:43.887077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a52d66-7843-4a2f-80b0-38904ad255a8 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:43.887363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a52d66-7843-4a2f-80b0-38904ad255a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:43.887645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a52d66-7843-4a2f-80b0-38904ad255a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:43.897345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a52d66-7843-4a2f-80b0-38904ad255a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:43.922863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a52d66-7843-4a2f-80b0-38904ad255a8 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:43.933568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 634/1269] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:29:48.574644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa99643-bb44-4ca5-af5b-be6b10d56fb2 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:48.575190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa99643-bb44-4ca5-af5b-be6b10d56fb2 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:48.575190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa99643-bb44-4ca5-af5b-be6b10d56fb2 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:48.576957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 636/1270] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:29:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:48.583525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf087-1f04-441d-8b7a-df0afa495bda None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:48.584323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf087-1f04-441d-8b7a-df0afa495bda None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:48.584323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf087-1f04-441d-8b7a-df0afa495bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:48.609006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e3ecf087-1f04-441d-8b7a-df0afa495bda None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:48.610217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e3ecf087-1f04-441d-8b7a-df0afa495bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:48.618087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 635/1271] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:29:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:48.656497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa99643-bb44-4ca5-af5b-be6b10d56fb2 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:29:48.668730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa99643-bb44-4ca5-af5b-be6b10d56fb2 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:29:48.672424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582718cb-934a-4339-8eb5-976389e33cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:29:48.673010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582718cb-934a-4339-8eb5-976389e33cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:48.673369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582718cb-934a-4339-8eb5-976389e33cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:48.673750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582718cb-934a-4339-8eb5-976389e33cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:48.683845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582718cb-934a-4339-8eb5-976389e33cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:29:48.709286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582718cb-934a-4339-8eb5-976389e33cd1 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:29:48.720178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 637/1272] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:29:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:29:53.525142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316226e1-1e3e-4195-8457-4713dc03e2c4 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:53.526060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316226e1-1e3e-4195-8457-4713dc03e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:53.526558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316226e1-1e3e-4195-8457-4713dc03e2c4 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:53.528739 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 636/1273] 10.222.0.67 () {54 vars in 921 bytes} [Thu Dec 16 14:29:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:53.534158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db815d8-6529-40ff-9d93-68bb7530cd8b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:53.535026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db815d8-6529-40ff-9d93-68bb7530cd8b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:53.535488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db815d8-6529-40ff-9d93-68bb7530cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:53.654716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6db815d8-6529-40ff-9d93-68bb7530cd8b None None] MFA Rules not processed for user `15e7b1dc56e949f2adb1744b492187a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:53.656160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6db815d8-6529-40ff-9d93-68bb7530cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:53.762884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 638/1274] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Dec 16 14:29:53 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:54.224189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648f10-c917-40cb-b20c-e25247bf69f5 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:54.224842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648f10-c917-40cb-b20c-e25247bf69f5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:54.225327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648f10-c917-40cb-b20c-e25247bf69f5 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:54.227741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 637/1275] 10.222.0.67 () {54 vars in 921 bytes} [Thu Dec 16 14:29:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:54.233046 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c608c-8ccd-45a3-89c1-00dbce431f77 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:54.233648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c608c-8ccd-45a3-89c1-00dbce431f77 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:54.234163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c608c-8ccd-45a3-89c1-00dbce431f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:54.258409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a00c608c-8ccd-45a3-89c1-00dbce431f77 None None] MFA Rules not processed for user `15e7b1dc56e949f2adb1744b492187a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:54.260048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a00c608c-8ccd-45a3-89c1-00dbce431f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:54.290089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 639/1276] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Dec 16 14:29:54 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:29:58.956032 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1939-0f9b-4e03-9b10-df7f969c837e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:58.956683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1939-0f9b-4e03-9b10-df7f969c837e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:58.956683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1939-0f9b-4e03-9b10-df7f969c837e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:58.958585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 638/1277] 10.222.0.67 () {54 vars in 921 bytes} [Thu Dec 16 14:29:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:29:58.964560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13024-ab1d-4ebb-b055-b996d5860783 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:29:58.965079 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13024-ab1d-4ebb-b055-b996d5860783 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:29:58.965198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba13024-ab1d-4ebb-b055-b996d5860783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:29:58.990591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-bba13024-ab1d-4ebb-b055-b996d5860783 None None] MFA Rules not processed for user `15e7b1dc56e949f2adb1744b492187a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:29:58.991755 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-bba13024-ab1d-4ebb-b055-b996d5860783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:29:59.002348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 640/1278] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Dec 16 14:29:58 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:01.110907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef8dd8-d267-4d51-a908-bd270941120e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:01.111549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef8dd8-d267-4d51-a908-bd270941120e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:01.111828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef8dd8-d267-4d51-a908-bd270941120e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:01.114103 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 639/1279] 10.222.0.67 () {54 vars in 921 bytes} [Thu Dec 16 14:30:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:01.120174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c213d7b-023b-430d-8e6f-d3494197add6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:01.120716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c213d7b-023b-430d-8e6f-d3494197add6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:01.120716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c213d7b-023b-430d-8e6f-d3494197add6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:01.157493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-7c213d7b-023b-430d-8e6f-d3494197add6 None None] MFA Rules not processed for user `15e7b1dc56e949f2adb1744b492187a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:01.159330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7c213d7b-023b-430d-8e6f-d3494197add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:01.171006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 641/1280] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Dec 16 14:30:01 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:04.410116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4229c-6544-4262-b11d-1f5f46adfcdc None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:04.410713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4229c-6544-4262-b11d-1f5f46adfcdc None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:04.410713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4229c-6544-4262-b11d-1f5f46adfcdc None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:04.412884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 640/1281] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:04.418776 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb370-efff-4931-963b-5a59af07141f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:04.419403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb370-efff-4931-963b-5a59af07141f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:04.419403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb370-efff-4931-963b-5a59af07141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:04.443676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-9a9eb370-efff-4931-963b-5a59af07141f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:04.445102 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9a9eb370-efff-4931-963b-5a59af07141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:04.452896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 642/1282] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:04.546190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea64a0-662b-4a2d-b18b-3fc46bff4a55 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:04.546545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea64a0-662b-4a2d-b18b-3fc46bff4a55 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:04.546890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea64a0-662b-4a2d-b18b-3fc46bff4a55 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:04.548694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 641/1283] 10.222.0.67 () {54 vars in 959 bytes} [Thu Dec 16 14:30:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:04.554885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6878df9-d2ce-40b1-af6b-af1f26164ded None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:04.555378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6878df9-d2ce-40b1-af6b-af1f26164ded None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:04.555764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6878df9-d2ce-40b1-af6b-af1f26164ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:04.630324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b6878df9-d2ce-40b1-af6b-af1f26164ded None None] MFA Rules not processed for user `f2bcc9f013f14ed89f5e94591f170b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:04.631521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b6878df9-d2ce-40b1-af6b-af1f26164ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:04.726670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 643/1284] 10.222.0.67 () {58 vars in 1056 bytes} [Thu Dec 16 14:30:04 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:04.734850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea64a0-662b-4a2d-b18b-3fc46bff4a55 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:04.750110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea64a0-662b-4a2d-b18b-3fc46bff4a55 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:04.755666 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c838c06-28d5-4a10-a2a2-57d099858e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:04.756848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c838c06-28d5-4a10-a2a2-57d099858e87 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:04.757137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c838c06-28d5-4a10-a2a2-57d099858e87 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:04.757423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c838c06-28d5-4a10-a2a2-57d099858e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:04.768386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c838c06-28d5-4a10-a2a2-57d099858e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:04.794576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c838c06-28d5-4a10-a2a2-57d099858e87 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:04.805838 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 642/1285] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:07.084315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567f12-fb4b-4d7a-a1b2-d4d6cf7a8e6a None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:07.084884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567f12-fb4b-4d7a-a1b2-d4d6cf7a8e6a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:07.084884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567f12-fb4b-4d7a-a1b2-d4d6cf7a8e6a None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:07.086517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 644/1286] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:07.097352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2976a-125e-47e2-8ccc-e58242a3df6c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:07.098070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2976a-125e-47e2-8ccc-e58242a3df6c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:07.098405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2976a-125e-47e2-8ccc-e58242a3df6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:07.139388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-8fc2976a-125e-47e2-8ccc-e58242a3df6c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:07.141392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8fc2976a-125e-47e2-8ccc-e58242a3df6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:07.151700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 643/1287] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:07.258673 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009967d7-e45c-4da3-9905-43979bccc070 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:07.259026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009967d7-e45c-4da3-9905-43979bccc070 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:07.259319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009967d7-e45c-4da3-9905-43979bccc070 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:07.261141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 645/1288] 10.222.0.67 () {54 vars in 959 bytes} [Thu Dec 16 14:30:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:30:07.266867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c279e-6533-42b1-96bc-df33370cac9b None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:07.267366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c279e-6533-42b1-96bc-df33370cac9b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:07.267803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c279e-6533-42b1-96bc-df33370cac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:07.292493 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b56c279e-6533-42b1-96bc-df33370cac9b None None] MFA Rules not processed for user `f2bcc9f013f14ed89f5e94591f170b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:07.293658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b56c279e-6533-42b1-96bc-df33370cac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:07.303022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 644/1289] 10.222.0.67 () {58 vars in 1056 bytes} [Thu Dec 16 14:30:07 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:07.312174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009967d7-e45c-4da3-9905-43979bccc070 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:07.327509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009967d7-e45c-4da3-9905-43979bccc070 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:07.332622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc6be3-4b93-40ee-8532-76d2c6979c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:07.333213 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc6be3-4b93-40ee-8532-76d2c6979c98 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:07.333497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc6be3-4b93-40ee-8532-76d2c6979c98 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:07.333774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc6be3-4b93-40ee-8532-76d2c6979c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:07.343853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc6be3-4b93-40ee-8532-76d2c6979c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:07.370545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc6be3-4b93-40ee-8532-76d2c6979c98 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:07.381363 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 646/1290] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:09.823309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e6046-3b85-45a0-9de8-62b9a7705c6c None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:09.823952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e6046-3b85-45a0-9de8-62b9a7705c6c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:09.824072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e6046-3b85-45a0-9de8-62b9a7705c6c None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:09.825845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 645/1291] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:30:09.831899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c7cf7-5ffc-4504-94ec-a40515a04148 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:09.832431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c7cf7-5ffc-4504-94ec-a40515a04148 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:09.832552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c7cf7-5ffc-4504-94ec-a40515a04148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:09.859929 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c93c7cf7-5ffc-4504-94ec-a40515a04148 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:09.861179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c93c7cf7-5ffc-4504-94ec-a40515a04148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:09.872613 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 647/1292] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:09.969620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e6046-3b85-45a0-9de8-62b9a7705c6c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:09.984820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e6046-3b85-45a0-9de8-62b9a7705c6c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:09.989723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067bd96-7c7e-49d2-bae5-0827d0db9e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:09.990377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067bd96-7c7e-49d2-bae5-0827d0db9e0d service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:09.990820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067bd96-7c7e-49d2-bae5-0827d0db9e0d service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:09.991863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067bd96-7c7e-49d2-bae5-0827d0db9e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:10.000955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067bd96-7c7e-49d2-bae5-0827d0db9e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:10.027970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067bd96-7c7e-49d2-bae5-0827d0db9e0d service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:10.038814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 646/1293] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:12.351654 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3f38f-d06b-4737-93cb-7e213e356908 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:12.352227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3f38f-d06b-4737-93cb-7e213e356908 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:12.352227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3f38f-d06b-4737-93cb-7e213e356908 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:12.353979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 648/1294] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:30:12.363790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc27d9-f680-46bf-b4c8-2ef1806f5f07 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:12.364380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc27d9-f680-46bf-b4c8-2ef1806f5f07 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:12.364380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc27d9-f680-46bf-b4c8-2ef1806f5f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:12.388084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-45dc27d9-f680-46bf-b4c8-2ef1806f5f07 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:12.389494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-45dc27d9-f680-46bf-b4c8-2ef1806f5f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:12.396772 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 647/1295] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:12.486830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3f38f-d06b-4737-93cb-7e213e356908 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:12.501833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3f38f-d06b-4737-93cb-7e213e356908 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:12.508588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ffc0-220a-4527-ac6d-746254e1931b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:12.509170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ffc0-220a-4527-ac6d-746254e1931b service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:12.509451 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ffc0-220a-4527-ac6d-746254e1931b service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:12.509719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ffc0-220a-4527-ac6d-746254e1931b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:12.518804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3ffc0-220a-4527-ac6d-746254e1931b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:12.544422 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3ffc0-220a-4527-ac6d-746254e1931b service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:12.555405 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 649/1296] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:14.823950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820aa5a9-de2a-4e7b-b221-bd7aae869e28 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:14.824495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820aa5a9-de2a-4e7b-b221-bd7aae869e28 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:14.824600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820aa5a9-de2a-4e7b-b221-bd7aae869e28 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:14.826298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 648/1297] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:14.831981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df801ca-de3d-4e6e-b246-18cffbc6d1ef None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:14.832473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df801ca-de3d-4e6e-b246-18cffbc6d1ef None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:14.832608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df801ca-de3d-4e6e-b246-18cffbc6d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:14.857210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-3df801ca-de3d-4e6e-b246-18cffbc6d1ef None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:14.858449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3df801ca-de3d-4e6e-b246-18cffbc6d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:14.867451 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 650/1298] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:14.955589 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820aa5a9-de2a-4e7b-b221-bd7aae869e28 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:14.974564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820aa5a9-de2a-4e7b-b221-bd7aae869e28 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:14.983794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d62f05-55fe-4e81-849e-c2015d2dc021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:14.984392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d62f05-55fe-4e81-849e-c2015d2dc021 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:14.984667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d62f05-55fe-4e81-849e-c2015d2dc021 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:14.984943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d62f05-55fe-4e81-849e-c2015d2dc021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:14.994496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d62f05-55fe-4e81-849e-c2015d2dc021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:15.021264 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d62f05-55fe-4e81-849e-c2015d2dc021 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:15.031812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 649/1299] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:17.305952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423de95-363f-4b98-aaef-ed8d827de7ed None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:17.306575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423de95-363f-4b98-aaef-ed8d827de7ed None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:17.306575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423de95-363f-4b98-aaef-ed8d827de7ed None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:17.308455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 651/1300] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:17.314979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03bceb-63b3-4fa9-9cd3-a782c023f50a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:17.315465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03bceb-63b3-4fa9-9cd3-a782c023f50a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:17.315557 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03bceb-63b3-4fa9-9cd3-a782c023f50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:17.351572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-ef03bceb-63b3-4fa9-9cd3-a782c023f50a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:17.352944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ef03bceb-63b3-4fa9-9cd3-a782c023f50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:17.361390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 650/1301] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:17.449151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423de95-363f-4b98-aaef-ed8d827de7ed None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:17.463996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423de95-363f-4b98-aaef-ed8d827de7ed None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:17.469620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1bf9-efc4-4ab3-b883-1456865e6f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:17.470246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1bf9-efc4-4ab3-b883-1456865e6f92 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:17.470530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1bf9-efc4-4ab3-b883-1456865e6f92 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:17.470804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1bf9-efc4-4ab3-b883-1456865e6f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:17.479507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa1bf9-efc4-4ab3-b883-1456865e6f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:17.504733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa1bf9-efc4-4ab3-b883-1456865e6f92 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:17.515510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 652/1302] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:19.712888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c9641-276f-45bb-a68f-99a2dd8935e5 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:19.713519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c9641-276f-45bb-a68f-99a2dd8935e5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:19.713519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c9641-276f-45bb-a68f-99a2dd8935e5 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:19.715376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 651/1303] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:30:19.720950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552692-eb31-4322-b66d-82248d8c89a9 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:19.721418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552692-eb31-4322-b66d-82248d8c89a9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:19.721512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552692-eb31-4322-b66d-82248d8c89a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:19.744558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-44552692-eb31-4322-b66d-82248d8c89a9 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:19.745741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-44552692-eb31-4322-b66d-82248d8c89a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:19.753025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 653/1304] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:19.839129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c9641-276f-45bb-a68f-99a2dd8935e5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:19.853724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c9641-276f-45bb-a68f-99a2dd8935e5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:19.859990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960f2ca-2a5b-4c41-ba96-b6a3a788df01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:19.860551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f2ca-2a5b-4c41-ba96-b6a3a788df01 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:19.860829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f2ca-2a5b-4c41-ba96-b6a3a788df01 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:19.861105 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f2ca-2a5b-4c41-ba96-b6a3a788df01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:19.870338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960f2ca-2a5b-4c41-ba96-b6a3a788df01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:19.895571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960f2ca-2a5b-4c41-ba96-b6a3a788df01 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:19.906025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 652/1305] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:21.918558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0cffd-8324-4639-abf7-f32888614ef1 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:21.919199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0cffd-8324-4639-abf7-f32888614ef1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:21.919453 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0cffd-8324-4639-abf7-f32888614ef1 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:21.921214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 654/1306] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:21.926899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1338-5971-45c7-8486-aa855b9d02af None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:21.927372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1338-5971-45c7-8486-aa855b9d02af None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:21.927500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1338-5971-45c7-8486-aa855b9d02af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:21.951237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4f7d1338-5971-45c7-8486-aa855b9d02af None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:21.952372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4f7d1338-5971-45c7-8486-aa855b9d02af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:21.959427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 653/1307] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:22.051231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0cffd-8324-4639-abf7-f32888614ef1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:22.067338 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0cffd-8324-4639-abf7-f32888614ef1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:22.073576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5849fd-987a-40e0-88e8-077433e7ed3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:22.074205 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5849fd-987a-40e0-88e8-077433e7ed3d service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:22.074489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5849fd-987a-40e0-88e8-077433e7ed3d service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:22.074763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5849fd-987a-40e0-88e8-077433e7ed3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:22.083304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5849fd-987a-40e0-88e8-077433e7ed3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:22.109778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5849fd-987a-40e0-88e8-077433e7ed3d service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:22.127153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 655/1308] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:24.240036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29dfe2-f142-42bb-83a8-860e2bb33f08 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:24.240746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29dfe2-f142-42bb-83a8-860e2bb33f08 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:24.240746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29dfe2-f142-42bb-83a8-860e2bb33f08 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:24.243104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 654/1309] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:24.249181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660e24c-d346-4d71-8c4d-d6483203abf4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:24.249689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660e24c-d346-4d71-8c4d-d6483203abf4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:24.249805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660e24c-d346-4d71-8c4d-d6483203abf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:24.274306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5660e24c-d346-4d71-8c4d-d6483203abf4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:24.275498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5660e24c-d346-4d71-8c4d-d6483203abf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:24.282851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 656/1310] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:24.375618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29dfe2-f142-42bb-83a8-860e2bb33f08 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:24.390081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29dfe2-f142-42bb-83a8-860e2bb33f08 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:24.395345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8b8a-8de7-4553-a532-4f5280ef5f79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:24.395939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8b8a-8de7-4553-a532-4f5280ef5f79 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:24.396219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8b8a-8de7-4553-a532-4f5280ef5f79 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:24.396496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8b8a-8de7-4553-a532-4f5280ef5f79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:24.406014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed8b8a-8de7-4553-a532-4f5280ef5f79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:24.436531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed8b8a-8de7-4553-a532-4f5280ef5f79 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:24.449298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 655/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:26.603668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7775b-211b-4291-a27a-a65e359492d8 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:26.604316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7775b-211b-4291-a27a-a65e359492d8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:26.604316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7775b-211b-4291-a27a-a65e359492d8 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:26.606084 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 657/1312] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:26.612546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854475a-4fa0-4f4d-8aa2-727d881fc347 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:26.613107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854475a-4fa0-4f4d-8aa2-727d881fc347 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:26.613107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854475a-4fa0-4f4d-8aa2-727d881fc347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:26.638345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3854475a-4fa0-4f4d-8aa2-727d881fc347 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:26.639452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3854475a-4fa0-4f4d-8aa2-727d881fc347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:26.647883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 656/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:26.749750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7775b-211b-4291-a27a-a65e359492d8 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:26.765721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7775b-211b-4291-a27a-a65e359492d8 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:26.771264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f96be-1ccd-49cc-9a05-4abccea1c79e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:26.771857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f96be-1ccd-49cc-9a05-4abccea1c79e service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:26.772143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f96be-1ccd-49cc-9a05-4abccea1c79e service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:26.772420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f96be-1ccd-49cc-9a05-4abccea1c79e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:26.781723 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f96be-1ccd-49cc-9a05-4abccea1c79e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:26.807558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f96be-1ccd-49cc-9a05-4abccea1c79e service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:26.817843 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 658/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:30:29.158697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf32d6-b37d-4e32-9b92-397e97578048 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:29.159474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf32d6-b37d-4e32-9b92-397e97578048 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:29.159474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf32d6-b37d-4e32-9b92-397e97578048 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:29.161022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 657/1315] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:29.167101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c1ff-ab6a-4528-9e68-89ec741d77d0 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:29.167681 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c1ff-ab6a-4528-9e68-89ec741d77d0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:29.167681 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c1ff-ab6a-4528-9e68-89ec741d77d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:29.191383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c5c9c1ff-ab6a-4528-9e68-89ec741d77d0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:29.192529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c5c9c1ff-ab6a-4528-9e68-89ec741d77d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:29.200060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 659/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:30:29.288030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf32d6-b37d-4e32-9b92-397e97578048 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:29.310373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf32d6-b37d-4e32-9b92-397e97578048 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:29.318337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2fe86-0b2d-4add-ba97-927afce7d17d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:29.319313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fe86-0b2d-4add-ba97-927afce7d17d service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:29.320188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fe86-0b2d-4add-ba97-927afce7d17d service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:29.320705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fe86-0b2d-4add-ba97-927afce7d17d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:29.336956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2fe86-0b2d-4add-ba97-927afce7d17d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:29.365224 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2fe86-0b2d-4add-ba97-927afce7d17d service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:29.377600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 658/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:32.044810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d700-f6ba-4460-96e6-5e7308e8e43b None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:32.045366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d700-f6ba-4460-96e6-5e7308e8e43b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:32.045366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d700-f6ba-4460-96e6-5e7308e8e43b None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:32.047072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 660/1318] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:32.053069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f26f5f-5621-4e41-ad8c-44379e96f35f None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:32.053583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f26f5f-5621-4e41-ad8c-44379e96f35f None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:32.053583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f26f5f-5621-4e41-ad8c-44379e96f35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:32.079808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f4f26f5f-5621-4e41-ad8c-44379e96f35f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:32.080987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f4f26f5f-5621-4e41-ad8c-44379e96f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:32.089227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 659/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:32.186100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d700-f6ba-4460-96e6-5e7308e8e43b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:32.200615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d700-f6ba-4460-96e6-5e7308e8e43b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:32.208598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e18fef-c822-4239-a3e1-90a47c45d596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:32.209243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18fef-c822-4239-a3e1-90a47c45d596 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:32.209587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18fef-c822-4239-a3e1-90a47c45d596 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:32.209928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18fef-c822-4239-a3e1-90a47c45d596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:32.220946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e18fef-c822-4239-a3e1-90a47c45d596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:32.247601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e18fef-c822-4239-a3e1-90a47c45d596 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:32.259013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 661/1320] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:42.777430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfddb6-3581-4ebe-a907-6163bfa7b898 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:42.779911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfddb6-3581-4ebe-a907-6163bfa7b898 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:42.780217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfddb6-3581-4ebe-a907-6163bfa7b898 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:42.782078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 660/1321] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:42 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:42.790545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0ef01-c85a-40cd-be4b-560cb4cbfd41 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:42.790545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0ef01-c85a-40cd-be4b-560cb4cbfd41 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:42.791634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0ef01-c85a-40cd-be4b-560cb4cbfd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:42.815350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a0e0ef01-c85a-40cd-be4b-560cb4cbfd41 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:42.816511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a0e0ef01-c85a-40cd-be4b-560cb4cbfd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:42.823911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 662/1322] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:42.887245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abb282-dd01-4885-a442-fc3129521ee0 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:42.887745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abb282-dd01-4885-a442-fc3129521ee0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:42.888080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abb282-dd01-4885-a442-fc3129521ee0 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:42.889793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 661/1323] 10.222.0.67 () {54 vars in 961 bytes} [Thu Dec 16 14:30:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:42.895111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6d7b-0fdd-4100-b1dc-f16b3894340d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:42.895410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6d7b-0fdd-4100-b1dc-f16b3894340d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:42.895693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6d7b-0fdd-4100-b1dc-f16b3894340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:42.971653 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-706a6d7b-0fdd-4100-b1dc-f16b3894340d None None] MFA Rules not processed for user `bb089e686c2540bfadf60b8ea010e441`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:42.972825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-706a6d7b-0fdd-4100-b1dc-f16b3894340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:43.044677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 663/1324] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Dec 16 14:30:42 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:43.052425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abb282-dd01-4885-a442-fc3129521ee0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:43.064533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abb282-dd01-4885-a442-fc3129521ee0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:43.067968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947f1ae-9965-464f-9061-c7b584cc4f06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:43.068605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947f1ae-9965-464f-9061-c7b584cc4f06 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:43.068954 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947f1ae-9965-464f-9061-c7b584cc4f06 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:43.069346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947f1ae-9965-464f-9061-c7b584cc4f06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:43.078899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947f1ae-9965-464f-9061-c7b584cc4f06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:43.105265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947f1ae-9965-464f-9061-c7b584cc4f06 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:43.116809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 662/1325] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:56.610013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75563e-dc88-48c4-b52e-357fb38737f2 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.610651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75563e-dc88-48c4-b52e-357fb38737f2 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.610651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75563e-dc88-48c4-b52e-357fb38737f2 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.612333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 664/1326] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:30:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:56.619296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0812f-c823-44b6-b2a8-0cdb681b7492 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.620019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0812f-c823-44b6-b2a8-0cdb681b7492 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.620019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0812f-c823-44b6-b2a8-0cdb681b7492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.644625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3cb0812f-c823-44b6-b2a8-0cdb681b7492 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:56.646392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3cb0812f-c823-44b6-b2a8-0cdb681b7492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:56.656513 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 663/1327] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:30:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:56.730195 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73bb40-8ce2-4899-9c63-2648f543875a None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.730457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73bb40-8ce2-4899-9c63-2648f543875a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.730746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73bb40-8ce2-4899-9c63-2648f543875a None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.732441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 665/1328] 10.222.0.67 () {54 vars in 956 bytes} [Thu Dec 16 14:30:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:30:56.739522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aaab9-5efe-472c-b33c-e9fea8cae438 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.739848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aaab9-5efe-472c-b33c-e9fea8cae438 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.740191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aaab9-5efe-472c-b33c-e9fea8cae438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.825164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-fa7aaab9-5efe-472c-b33c-e9fea8cae438 None None] MFA Rules not processed for user `0b797c99041b4e9c9cde7d0064013fda`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:56.827329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-fa7aaab9-5efe-472c-b33c-e9fea8cae438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:56.903299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 664/1329] 10.222.0.67 () {58 vars in 1053 bytes} [Thu Dec 16 14:30:56 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:56.913854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73bb40-8ce2-4899-9c63-2648f543875a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:56.926599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73bb40-8ce2-4899-9c63-2648f543875a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:56.930681 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9934c-c0db-4880-80ff-78044a261314 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b797c99041b4e9c9cde7d0064013fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:56.931667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9934c-c0db-4880-80ff-78044a261314 service glance] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:56.931961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9934c-c0db-4880-80ff-78044a261314 service glance] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:56.932243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9934c-c0db-4880-80ff-78044a261314 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:56.942655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9934c-c0db-4880-80ff-78044a261314 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:56.968526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9934c-c0db-4880-80ff-78044a261314 service glance] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:56.980185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 666/1330] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:30:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:30:57.605036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6a8e5-fc5c-4942-b216-a2bf201704bd None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:57.605449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6a8e5-fc5c-4942-b216-a2bf201704bd None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:57.605858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6a8e5-fc5c-4942-b216-a2bf201704bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:57.697207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-fde6a8e5-fc5c-4942-b216-a2bf201704bd None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:57.698842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-fde6a8e5-fc5c-4942-b216-a2bf201704bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:57.776555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 665/1331] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:30:57 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:30:57.826814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfda17-d173-478b-a629-b8a677d5e8fa None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:57.827355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfda17-d173-478b-a629-b8a677d5e8fa None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:57.827355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfda17-d173-478b-a629-b8a677d5e8fa None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:57.829082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 667/1332] 10.222.0.67 () {54 vars in 942 bytes} [Thu Dec 16 14:30:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:30:57.837230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d16b4e-f98e-44e7-852e-beb5fe2be225 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:57.837524 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d16b4e-f98e-44e7-852e-beb5fe2be225 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:57.837884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d16b4e-f98e-44e7-852e-beb5fe2be225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:57.912623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c1d16b4e-f98e-44e7-852e-beb5fe2be225 None None] MFA Rules not processed for user `f757256b0c684c61a90421d1aec1d31d`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:30:57.913779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c1d16b4e-f98e-44e7-852e-beb5fe2be225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:30:57.998327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 666/1333] 10.222.0.67 () {58 vars in 1039 bytes} [Thu Dec 16 14:30:57 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:30:58.007633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfda17-d173-478b-a629-b8a677d5e8fa None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:30:58.021733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfda17-d173-478b-a629-b8a677d5e8fa None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:30:58.027003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfb304-05ee-47c9-b787-ce313c97831b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:30:58.027514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb304-05ee-47c9-b787-ce313c97831b service swift] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:30:58.027793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb304-05ee-47c9-b787-ce313c97831b service swift] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:30:58.028066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfb304-05ee-47c9-b787-ce313c97831b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:30:58.037072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfb304-05ee-47c9-b787-ce313c97831b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:30:58.063006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfb304-05ee-47c9-b787-ce313c97831b service swift] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:30:58.072480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 668/1334] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:30:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:31:18.120507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc5917-92af-4213-8cc9-ca47fb104cd0 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:18.121286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc5917-92af-4213-8cc9-ca47fb104cd0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:18.121286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc5917-92af-4213-8cc9-ca47fb104cd0 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:18.123008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 667/1335] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:31:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:18.130040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09493-8186-4c80-8fb4-cf432bc23682 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:18.130601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09493-8186-4c80-8fb4-cf432bc23682 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:18.130928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09493-8186-4c80-8fb4-cf432bc23682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:18.168309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-f3a09493-8186-4c80-8fb4-cf432bc23682 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:18.170087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f3a09493-8186-4c80-8fb4-cf432bc23682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:18.180720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 669/1336] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:18.204868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc5917-92af-4213-8cc9-ca47fb104cd0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:18.220406 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc5917-92af-4213-8cc9-ca47fb104cd0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:18.226293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5a5e2-731f-4cf9-886c-08f5dbd47778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:18.227088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5a5e2-731f-4cf9-886c-08f5dbd47778 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:18.228097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5a5e2-731f-4cf9-886c-08f5dbd47778 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:18.228097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5a5e2-731f-4cf9-886c-08f5dbd47778 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:18.228658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5a5e2-731f-4cf9-886c-08f5dbd47778 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:18.256147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5a5e2-731f-4cf9-886c-08f5dbd47778 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:18.274027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 668/1337] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:31:18 2021] GET /identity/v3/projects => generated 2553 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:31:20.676873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830378c-da3d-4f8a-b346-da6488d161d6 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:20.677568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830378c-da3d-4f8a-b346-da6488d161d6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:20.677568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830378c-da3d-4f8a-b346-da6488d161d6 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:20.679447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 670/1338] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:31:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:20.685793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd014a2-3f7d-428a-ad17-5c9e6ad3f9b7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:20.686573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd014a2-3f7d-428a-ad17-5c9e6ad3f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:20.686746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd014a2-3f7d-428a-ad17-5c9e6ad3f9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:20.713082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3cd014a2-3f7d-428a-ad17-5c9e6ad3f9b7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:20.714396 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3cd014a2-3f7d-428a-ad17-5c9e6ad3f9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:20.722661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 669/1339] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:20.745211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830378c-da3d-4f8a-b346-da6488d161d6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:20.758946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830378c-da3d-4f8a-b346-da6488d161d6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:20.763534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76025c-2168-49b3-85ea-155b017c9c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:20.764323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76025c-2168-49b3-85ea-155b017c9c57 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:20.764608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76025c-2168-49b3-85ea-155b017c9c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:20.764881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76025c-2168-49b3-85ea-155b017c9c57 admin admin] PATH_INFO: `/v3/projects/0156957cb88e41a2a33d5a862c550bad` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:20.778809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76025c-2168-49b3-85ea-155b017c9c57 admin admin] RBAC: Authorizing `identity:get_project(project_id=0156957cb88e41a2a33d5a862c550bad)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:20.806836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76025c-2168-49b3-85ea-155b017c9c57 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:20.810337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 671/1340] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:31:20 2021] GET /identity/v3/projects/0156957cb88e41a2a33d5a862c550bad => generated 312 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:20.815800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd014a2-3f7d-428a-ad17-5c9e6ad3f9b7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:20.825472 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd014a2-3f7d-428a-ad17-5c9e6ad3f9b7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:20.829926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec6ddd-8cd6-42bb-9110-0d9fdff2d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:20.831548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec6ddd-8cd6-42bb-9110-0d9fdff2d869 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:20.831841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec6ddd-8cd6-42bb-9110-0d9fdff2d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:20.832110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec6ddd-8cd6-42bb-9110-0d9fdff2d869 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:20.832891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec6ddd-8cd6-42bb-9110-0d9fdff2d869 admin admin] RBAC: Adding query filter params (scope.project.id=0156957cb88e41a2a33d5a862c550bad) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:31:20.833172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec6ddd-8cd6-42bb-9110-0d9fdff2d869 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:20.859089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec6ddd-8cd6-42bb-9110-0d9fdff2d869 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:20.865673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 670/1341] 10.222.0.67 () {56 vars in 1231 bytes} [Thu Dec 16 14:31:20 2021] GET /identity/v3/role_assignments?scope.project.id=0156957cb88e41a2a33d5a862c550bad => generated 526 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:20.871965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76025c-2168-49b3-85ea-155b017c9c57 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:20.882578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76025c-2168-49b3-85ea-155b017c9c57 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:20.887670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a377-3981-44c7-b083-564cb4c29248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:20.888489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a377-3981-44c7-b083-564cb4c29248 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:20.888849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a377-3981-44c7-b083-564cb4c29248 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:20.889139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a377-3981-44c7-b083-564cb4c29248 admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:20.909756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4a377-3981-44c7-b083-564cb4c29248 admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:20.936910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4a377-3981-44c7-b083-564cb4c29248 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:20.938499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 672/1342] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:20 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:31:23.303790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c77d3-e7c1-4b0d-92f7-23ab95a6d661 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:23.304357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c77d3-e7c1-4b0d-92f7-23ab95a6d661 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:23.304357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c77d3-e7c1-4b0d-92f7-23ab95a6d661 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:23.306265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 671/1343] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:31:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:31:23.315730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a649d-5951-4e22-802e-84c43bf4cca1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:23.316253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a649d-5951-4e22-802e-84c43bf4cca1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:23.316638 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a649d-5951-4e22-802e-84c43bf4cca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:23.353371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d55a649d-5951-4e22-802e-84c43bf4cca1 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:23.355314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d55a649d-5951-4e22-802e-84c43bf4cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:23.365851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 673/1344] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:23.400538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c77d3-e7c1-4b0d-92f7-23ab95a6d661 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:23.414643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c77d3-e7c1-4b0d-92f7-23ab95a6d661 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:23.419750 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832efd0c-71c4-4f33-9c89-b78a1d12a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:23.420655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832efd0c-71c4-4f33-9c89-b78a1d12a7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:23.420940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832efd0c-71c4-4f33-9c89-b78a1d12a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:23.421217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832efd0c-71c4-4f33-9c89-b78a1d12a7f4 admin admin] PATH_INFO: `/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:23.435859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832efd0c-71c4-4f33-9c89-b78a1d12a7f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=1a005ad2a4cb4610a75fae6a82ec7241)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:23.462379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832efd0c-71c4-4f33-9c89-b78a1d12a7f4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:23.464295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 672/1345] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:31:23 2021] GET /identity/v3/projects/1a005ad2a4cb4610a75fae6a82ec7241 => generated 311 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:23.473861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a649d-5951-4e22-802e-84c43bf4cca1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:23.483713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a649d-5951-4e22-802e-84c43bf4cca1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:23.489116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62269908-6ec3-45e0-8cce-908932ba9f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:23.489717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62269908-6ec3-45e0-8cce-908932ba9f4c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:23.490026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62269908-6ec3-45e0-8cce-908932ba9f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:23.490336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62269908-6ec3-45e0-8cce-908932ba9f4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:23.491071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62269908-6ec3-45e0-8cce-908932ba9f4c admin admin] RBAC: Adding query filter params (scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:31:23.491376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62269908-6ec3-45e0-8cce-908932ba9f4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:23.516927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62269908-6ec3-45e0-8cce-908932ba9f4c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:23.524520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 674/1346] 10.222.0.67 () {56 vars in 1231 bytes} [Thu Dec 16 14:31:23 2021] GET /identity/v3/role_assignments?scope.project.id=1a005ad2a4cb4610a75fae6a82ec7241 => generated 877 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:23.531822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832efd0c-71c4-4f33-9c89-b78a1d12a7f4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:23.542365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832efd0c-71c4-4f33-9c89-b78a1d12a7f4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:23.547712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa3a8-6635-4d4b-9362-a57edd714b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:23.548574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa3a8-6635-4d4b-9362-a57edd714b84 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:23.548898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa3a8-6635-4d4b-9362-a57edd714b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:23.549223 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa3a8-6635-4d4b-9362-a57edd714b84 admin admin] PATH_INFO: `/v3/users/0a6c5d872485449eb83793caca978cd5` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:23.571422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa3a8-6635-4d4b-9362-a57edd714b84 admin admin] RBAC: Authorizing `identity:get_user(user_id=0a6c5d872485449eb83793caca978cd5)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:23.600082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa3a8-6635-4d4b-9362-a57edd714b84 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:23.601805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 673/1347] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:23 2021] GET /identity/v3/users/0a6c5d872485449eb83793caca978cd5 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:23.608890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62269908-6ec3-45e0-8cce-908932ba9f4c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:23.619771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62269908-6ec3-45e0-8cce-908932ba9f4c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:23.624797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8806181-f6ff-4b57-9ab2-2f8757ec9d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:23.625743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806181-f6ff-4b57-9ab2-2f8757ec9d33 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:23.626109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806181-f6ff-4b57-9ab2-2f8757ec9d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:23.626432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806181-f6ff-4b57-9ab2-2f8757ec9d33 admin admin] PATH_INFO: `/v3/users/97e7314588aa4b369d6f07d066cd3da7` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:23.647549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8806181-f6ff-4b57-9ab2-2f8757ec9d33 admin admin] RBAC: Authorizing `identity:get_user(user_id=97e7314588aa4b369d6f07d066cd3da7)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:23.675116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8806181-f6ff-4b57-9ab2-2f8757ec9d33 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:23.676839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 675/1348] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:23 2021] GET /identity/v3/users/97e7314588aa4b369d6f07d066cd3da7 => generated 285 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:25.848716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8b6bf-33f3-42ef-bde1-f13592ac1474 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:25.849338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8b6bf-33f3-42ef-bde1-f13592ac1474 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:25.849338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8b6bf-33f3-42ef-bde1-f13592ac1474 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:25.851071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 674/1349] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:31:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:25.857003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018bc39-6aaa-4a95-b95e-367079482c8d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:25.857567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018bc39-6aaa-4a95-b95e-367079482c8d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:25.857567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018bc39-6aaa-4a95-b95e-367079482c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:25.880490 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0018bc39-6aaa-4a95-b95e-367079482c8d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:25.881649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0018bc39-6aaa-4a95-b95e-367079482c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:25.889263 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 676/1350] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:25.912166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8b6bf-33f3-42ef-bde1-f13592ac1474 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:25.925697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8b6bf-33f3-42ef-bde1-f13592ac1474 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:25.930476 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced2d51-19e7-498c-9af8-e3c86c39792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:25.931302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2d51-19e7-498c-9af8-e3c86c39792b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:25.931574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2d51-19e7-498c-9af8-e3c86c39792b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:25.931857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced2d51-19e7-498c-9af8-e3c86c39792b admin admin] PATH_INFO: `/v3/projects/2eda9161f20442c0af550cdfbd0da7dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:25.946574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced2d51-19e7-498c-9af8-e3c86c39792b admin admin] RBAC: Authorizing `identity:get_project(project_id=2eda9161f20442c0af550cdfbd0da7dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:25.972751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced2d51-19e7-498c-9af8-e3c86c39792b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:25.974556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 675/1351] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:31:25 2021] GET /identity/v3/projects/2eda9161f20442c0af550cdfbd0da7dc => generated 302 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:25.981753 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018bc39-6aaa-4a95-b95e-367079482c8d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:25.990851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018bc39-6aaa-4a95-b95e-367079482c8d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:25.995200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775b841-a5ac-4d9a-a8b5-f367a3697485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:25.995823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775b841-a5ac-4d9a-a8b5-f367a3697485 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:25.996443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775b841-a5ac-4d9a-a8b5-f367a3697485 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:25.998160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775b841-a5ac-4d9a-a8b5-f367a3697485 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:25.998953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775b841-a5ac-4d9a-a8b5-f367a3697485 admin admin] RBAC: Adding query filter params (scope.project.id=2eda9161f20442c0af550cdfbd0da7dc) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:31:25.999246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775b841-a5ac-4d9a-a8b5-f367a3697485 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:26.025376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775b841-a5ac-4d9a-a8b5-f367a3697485 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:26.033965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 677/1352] 10.222.0.67 () {56 vars in 1231 bytes} [Thu Dec 16 14:31:25 2021] GET /identity/v3/role_assignments?scope.project.id=2eda9161f20442c0af550cdfbd0da7dc => generated 1934 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:31:26.040829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced2d51-19e7-498c-9af8-e3c86c39792b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:26.051534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced2d51-19e7-498c-9af8-e3c86c39792b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:26.056650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec9cf7-66f5-4b26-a8b4-193d087e3b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:26.057539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9cf7-66f5-4b26-a8b4-193d087e3b32 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:26.057937 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9cf7-66f5-4b26-a8b4-193d087e3b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:26.058728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9cf7-66f5-4b26-a8b4-193d087e3b32 admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:26.060698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec9cf7-66f5-4b26-a8b4-193d087e3b32 admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:26.086925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec9cf7-66f5-4b26-a8b4-193d087e3b32 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:26.088507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 676/1353] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:26 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:26.095128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775b841-a5ac-4d9a-a8b5-f367a3697485 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:26.105528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775b841-a5ac-4d9a-a8b5-f367a3697485 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:26.110025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6d5e4-9de7-4683-90ae-37747034e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:26.110845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6d5e4-9de7-4683-90ae-37747034e1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:26.111240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6d5e4-9de7-4683-90ae-37747034e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:26.111517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6d5e4-9de7-4683-90ae-37747034e1c3 admin admin] PATH_INFO: `/v3/users/8c0b42a164964ff296253cb2e8ee9e93` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:26.132001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6d5e4-9de7-4683-90ae-37747034e1c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c0b42a164964ff296253cb2e8ee9e93)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:26.158266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6d5e4-9de7-4683-90ae-37747034e1c3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:26.159957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 678/1354] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:26 2021] GET /identity/v3/users/8c0b42a164964ff296253cb2e8ee9e93 => generated 283 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:28.267426 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a58439-f78e-41ca-8a6f-10fa8e5e8e39 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:28.268043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a58439-f78e-41ca-8a6f-10fa8e5e8e39 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:28.268043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a58439-f78e-41ca-8a6f-10fa8e5e8e39 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:28.269705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 677/1355] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:31:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:28.275335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2282dc-32eb-43c3-9cbd-cd9c013e22b0 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:28.275853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2282dc-32eb-43c3-9cbd-cd9c013e22b0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:28.275853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2282dc-32eb-43c3-9cbd-cd9c013e22b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:28.306792 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-4d2282dc-32eb-43c3-9cbd-cd9c013e22b0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:28.307975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4d2282dc-32eb-43c3-9cbd-cd9c013e22b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:28.317557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 679/1356] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:28.341064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a58439-f78e-41ca-8a6f-10fa8e5e8e39 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:28.354852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a58439-f78e-41ca-8a6f-10fa8e5e8e39 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:28.360813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c9ee-51d3-4763-9a7f-07737281ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:28.361632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c9ee-51d3-4763-9a7f-07737281ab89 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:28.361914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c9ee-51d3-4763-9a7f-07737281ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:28.362226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c9ee-51d3-4763-9a7f-07737281ab89 admin admin] PATH_INFO: `/v3/projects/51da8a0e339842cabf730613493a13d2` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:28.376990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c9ee-51d3-4763-9a7f-07737281ab89 admin admin] RBAC: Authorizing `identity:get_project(project_id=51da8a0e339842cabf730613493a13d2)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:28.403578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c9ee-51d3-4763-9a7f-07737281ab89 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:28.405411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 678/1357] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:31:28 2021] GET /identity/v3/projects/51da8a0e339842cabf730613493a13d2 => generated 311 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:28.411943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2282dc-32eb-43c3-9cbd-cd9c013e22b0 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:28.421824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2282dc-32eb-43c3-9cbd-cd9c013e22b0 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:28.427034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7096-2cad-42ad-81d8-707d07538b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:28.427642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7096-2cad-42ad-81d8-707d07538b64 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:28.427931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7096-2cad-42ad-81d8-707d07538b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:28.428206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7096-2cad-42ad-81d8-707d07538b64 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:28.428948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7096-2cad-42ad-81d8-707d07538b64 admin admin] RBAC: Adding query filter params (scope.project.id=51da8a0e339842cabf730613493a13d2) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:31:28.429248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7096-2cad-42ad-81d8-707d07538b64 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:28.455496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7096-2cad-42ad-81d8-707d07538b64 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:28.462149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 680/1358] 10.222.0.67 () {56 vars in 1231 bytes} [Thu Dec 16 14:31:28 2021] GET /identity/v3/role_assignments?scope.project.id=51da8a0e339842cabf730613493a13d2 => generated 526 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:28.468803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c9ee-51d3-4763-9a7f-07737281ab89 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:28.478828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c9ee-51d3-4763-9a7f-07737281ab89 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:28.483732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c43f50-d549-47f0-9044-e0e6aa838283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:28.484552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c43f50-d549-47f0-9044-e0e6aa838283 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:28.484815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c43f50-d549-47f0-9044-e0e6aa838283 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:28.485093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c43f50-d549-47f0-9044-e0e6aa838283 admin admin] PATH_INFO: `/v3/users/8d467b6286c04851a28298de9fdb6477` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:28.505177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c43f50-d549-47f0-9044-e0e6aa838283 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d467b6286c04851a28298de9fdb6477)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:28.531727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c43f50-d549-47f0-9044-e0e6aa838283 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:28.533394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 679/1359] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:28 2021] GET /identity/v3/users/8d467b6286c04851a28298de9fdb6477 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:30.588437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4c7a-ff4a-49c2-ba87-ac7b71de0803 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:30.588986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4c7a-ff4a-49c2-ba87-ac7b71de0803 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:30.588986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4c7a-ff4a-49c2-ba87-ac7b71de0803 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:30.590706 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 681/1360] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:31:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:30.596567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946b15-a160-4cf0-a5f7-8b970ba2e128 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:30.597051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946b15-a160-4cf0-a5f7-8b970ba2e128 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:30.597181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946b15-a160-4cf0-a5f7-8b970ba2e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:30.620818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-30946b15-a160-4cf0-a5f7-8b970ba2e128 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:30.622026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-30946b15-a160-4cf0-a5f7-8b970ba2e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:30.630259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 680/1361] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:30.657324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c4c7a-ff4a-49c2-ba87-ac7b71de0803 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:30.676960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c4c7a-ff4a-49c2-ba87-ac7b71de0803 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:30.682207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfc43c-f029-4ba2-b0f0-91017a71c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:30.682989 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfc43c-f029-4ba2-b0f0-91017a71c12a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:30.683274 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfc43c-f029-4ba2-b0f0-91017a71c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:30.683551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfc43c-f029-4ba2-b0f0-91017a71c12a admin admin] PATH_INFO: `/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:30.685169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfc43c-f029-4ba2-b0f0-91017a71c12a admin admin] RBAC: Authorizing `identity:get_project(project_id=5ccd5dcafb684ba88fe8fe109a2798be)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:30.712390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfc43c-f029-4ba2-b0f0-91017a71c12a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:30.714352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 682/1362] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:31:30 2021] GET /identity/v3/projects/5ccd5dcafb684ba88fe8fe109a2798be => generated 344 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:30.720817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30946b15-a160-4cf0-a5f7-8b970ba2e128 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:30.729969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30946b15-a160-4cf0-a5f7-8b970ba2e128 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:30.734819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456b437-174f-4b76-bbd6-043e63436f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:30.735407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456b437-174f-4b76-bbd6-043e63436f84 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:30.735687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456b437-174f-4b76-bbd6-043e63436f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:30.735962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456b437-174f-4b76-bbd6-043e63436f84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:30.736689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456b437-174f-4b76-bbd6-043e63436f84 admin admin] RBAC: Adding query filter params (scope.project.id=5ccd5dcafb684ba88fe8fe109a2798be) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:31:30.736979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456b437-174f-4b76-bbd6-043e63436f84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:30.762489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456b437-174f-4b76-bbd6-043e63436f84 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:30.769216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 681/1363] 10.222.0.67 () {56 vars in 1231 bytes} [Thu Dec 16 14:31:30 2021] GET /identity/v3/role_assignments?scope.project.id=5ccd5dcafb684ba88fe8fe109a2798be => generated 879 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:31:30.775365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfc43c-f029-4ba2-b0f0-91017a71c12a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:30.785926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfc43c-f029-4ba2-b0f0-91017a71c12a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:30.791614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743681e4-a44a-4e08-9009-1f0eb6d187ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:30.792429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743681e4-a44a-4e08-9009-1f0eb6d187ed admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:30.792712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743681e4-a44a-4e08-9009-1f0eb6d187ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:30.792993 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743681e4-a44a-4e08-9009-1f0eb6d187ed admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:30.794265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743681e4-a44a-4e08-9009-1f0eb6d187ed admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:30.823410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743681e4-a44a-4e08-9009-1f0eb6d187ed admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:30.825318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 683/1364] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:30 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:32.939933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879b26-4762-4410-9a80-8b01f3428c05 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:32.940538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879b26-4762-4410-9a80-8b01f3428c05 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:32.940538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879b26-4762-4410-9a80-8b01f3428c05 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:32.942220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 682/1365] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:31:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:32.947688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac6df5-fdc4-42e0-bdd5-35954d451d85 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:32.948169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac6df5-fdc4-42e0-bdd5-35954d451d85 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:32.948263 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac6df5-fdc4-42e0-bdd5-35954d451d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:32.974633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-95ac6df5-fdc4-42e0-bdd5-35954d451d85 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:32.975819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-95ac6df5-fdc4-42e0-bdd5-35954d451d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:32.984878 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 684/1366] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:33.008000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879b26-4762-4410-9a80-8b01f3428c05 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:33.021250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879b26-4762-4410-9a80-8b01f3428c05 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:33.026017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd245d-1af0-4449-8fa5-04e1a7174aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:33.026871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd245d-1af0-4449-8fa5-04e1a7174aaa admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:33.027157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd245d-1af0-4449-8fa5-04e1a7174aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:33.027442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd245d-1af0-4449-8fa5-04e1a7174aaa admin admin] PATH_INFO: `/v3/projects/7147b4d392a04e67b37e1623c5c91db7` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:33.042464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd245d-1af0-4449-8fa5-04e1a7174aaa admin admin] RBAC: Authorizing `identity:get_project(project_id=7147b4d392a04e67b37e1623c5c91db7)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:33.069157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd245d-1af0-4449-8fa5-04e1a7174aaa admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:33.070902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 683/1367] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:31:33 2021] GET /identity/v3/projects/7147b4d392a04e67b37e1623c5c91db7 => generated 361 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:33.078836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac6df5-fdc4-42e0-bdd5-35954d451d85 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:33.088444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac6df5-fdc4-42e0-bdd5-35954d451d85 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:33.094486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a611a7-456c-4445-a822-e9daad0e4fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:33.095101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a611a7-456c-4445-a822-e9daad0e4fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:33.095513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a611a7-456c-4445-a822-e9daad0e4fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:33.095803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a611a7-456c-4445-a822-e9daad0e4fc7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:33.096781 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a611a7-456c-4445-a822-e9daad0e4fc7 admin admin] RBAC: Adding query filter params (scope.project.id=7147b4d392a04e67b37e1623c5c91db7) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:31:33.097086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a611a7-456c-4445-a822-e9daad0e4fc7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:33.123571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a611a7-456c-4445-a822-e9daad0e4fc7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:33.130112 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 685/1368] 10.222.0.67 () {56 vars in 1231 bytes} [Thu Dec 16 14:31:33 2021] GET /identity/v3/role_assignments?scope.project.id=7147b4d392a04e67b37e1623c5c91db7 => generated 526 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:33.136471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd245d-1af0-4449-8fa5-04e1a7174aaa admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:33.147348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd245d-1af0-4449-8fa5-04e1a7174aaa admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:33.152946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b4790-75f8-4262-b605-df0c938f4cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:33.153694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4790-75f8-4262-b605-df0c938f4cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:33.153978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4790-75f8-4262-b605-df0c938f4cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:33.154294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4790-75f8-4262-b605-df0c938f4cf4 admin admin] PATH_INFO: `/v3/users/aa106fe70f4b458a98fa495801d65613` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:33.174593 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b4790-75f8-4262-b605-df0c938f4cf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=aa106fe70f4b458a98fa495801d65613)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:33.201263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b4790-75f8-4262-b605-df0c938f4cf4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:33.202910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 684/1369] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:33 2021] GET /identity/v3/users/aa106fe70f4b458a98fa495801d65613 => generated 311 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:35.234592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc120a-61c0-4c93-823e-ffa81eb92fc9 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:35.235223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc120a-61c0-4c93-823e-ffa81eb92fc9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:35.235223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc120a-61c0-4c93-823e-ffa81eb92fc9 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:35.236950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 686/1370] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:31:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:35.242619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71ee8-5bee-4e4a-961c-fc4da5ce3861 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:35.243085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71ee8-5bee-4e4a-961c-fc4da5ce3861 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:35.243213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71ee8-5bee-4e4a-961c-fc4da5ce3861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:35.267162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f2f71ee8-5bee-4e4a-961c-fc4da5ce3861 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:35.268329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f2f71ee8-5bee-4e4a-961c-fc4da5ce3861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:35.276841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 685/1371] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:31:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:35.299915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc120a-61c0-4c93-823e-ffa81eb92fc9 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:35.314052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc120a-61c0-4c93-823e-ffa81eb92fc9 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:35.318512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108bcf-d352-4a80-9b0e-d1bc1ff7b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:35.319315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108bcf-d352-4a80-9b0e-d1bc1ff7b0ff admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:35.319592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108bcf-d352-4a80-9b0e-d1bc1ff7b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:35.319895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108bcf-d352-4a80-9b0e-d1bc1ff7b0ff admin admin] PATH_INFO: `/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:35.333940 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe108bcf-d352-4a80-9b0e-d1bc1ff7b0ff admin admin] RBAC: Authorizing `identity:get_project(project_id=ec15c254e4e4438ba97f65c3eb214d1d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:35.359969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe108bcf-d352-4a80-9b0e-d1bc1ff7b0ff admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:35.361825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 687/1372] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Dec 16 14:31:35 2021] GET /identity/v3/projects/ec15c254e4e4438ba97f65c3eb214d1d => generated 298 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:35.368600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71ee8-5bee-4e4a-961c-fc4da5ce3861 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:35.378617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71ee8-5bee-4e4a-961c-fc4da5ce3861 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:35.383352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db3c2e-420c-4e39-b634-1f4781ba1fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:35.383964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db3c2e-420c-4e39-b634-1f4781ba1fdb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:35.384232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db3c2e-420c-4e39-b634-1f4781ba1fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:35.384531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db3c2e-420c-4e39-b634-1f4781ba1fdb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:35.385277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db3c2e-420c-4e39-b634-1f4781ba1fdb admin admin] RBAC: Adding query filter params (scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:31:35.385568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db3c2e-420c-4e39-b634-1f4781ba1fdb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:35.412737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db3c2e-420c-4e39-b634-1f4781ba1fdb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:35.421567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 686/1373] 10.222.0.67 () {56 vars in 1231 bytes} [Thu Dec 16 14:31:35 2021] GET /identity/v3/role_assignments?scope.project.id=ec15c254e4e4438ba97f65c3eb214d1d => generated 1934 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:31:35.427990 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108bcf-d352-4a80-9b0e-d1bc1ff7b0ff admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:35.440924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108bcf-d352-4a80-9b0e-d1bc1ff7b0ff admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:35.446021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ffe1f-4761-4581-b47a-229e1c6f387a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:35.446831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ffe1f-4761-4581-b47a-229e1c6f387a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:35.447109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ffe1f-4761-4581-b47a-229e1c6f387a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:35.447380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ffe1f-4761-4581-b47a-229e1c6f387a admin admin] PATH_INFO: `/v3/users/fd2894712b85445fbc68a4343ad9d3bf` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:35.448579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ffe1f-4761-4581-b47a-229e1c6f387a admin admin] RBAC: Authorizing `identity:get_user(user_id=fd2894712b85445fbc68a4343ad9d3bf)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:35.474732 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ffe1f-4761-4581-b47a-229e1c6f387a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:35.476362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 688/1374] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:35 2021] GET /identity/v3/users/fd2894712b85445fbc68a4343ad9d3bf => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:31:35.482907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db3c2e-420c-4e39-b634-1f4781ba1fdb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:35.493357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db3c2e-420c-4e39-b634-1f4781ba1fdb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:35.498767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ce1b5-0056-4fb0-9d71-6ab662738ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:35.499578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ce1b5-0056-4fb0-9d71-6ab662738ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:35.499861 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ce1b5-0056-4fb0-9d71-6ab662738ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:35.500138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ce1b5-0056-4fb0-9d71-6ab662738ed9 admin admin] PATH_INFO: `/v3/users/69b3dce5d565425ca928deea4c6b8503` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:35.501285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ce1b5-0056-4fb0-9d71-6ab662738ed9 admin admin] RBAC: Authorizing `identity:get_user(user_id=69b3dce5d565425ca928deea4c6b8503)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:35.527745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ce1b5-0056-4fb0-9d71-6ab662738ed9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:35.530021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 687/1375] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Dec 16 14:31:35 2021] GET /identity/v3/users/69b3dce5d565425ca928deea4c6b8503 => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:31:40.400941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c9161-c681-4673-ab62-4247b59547d1 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:40.401813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c9161-c681-4673-ab62-4247b59547d1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:40.401813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c9161-c681-4673-ab62-4247b59547d1 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:40.403316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 689/1376] 10.222.0.67 () {54 vars in 918 bytes} [Thu Dec 16 14:31:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:40.409040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d96822-8e48-4759-871b-e75efde1a978 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:40.409479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d96822-8e48-4759-871b-e75efde1a978 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:40.409580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d96822-8e48-4759-871b-e75efde1a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:40.435321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-93d96822-8e48-4759-871b-e75efde1a978 None None] MFA Rules not processed for user `15e7b1dc56e949f2adb1744b492187a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:40.436739 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-93d96822-8e48-4759-871b-e75efde1a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:40.445387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 688/1377] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Dec 16 14:31:40 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:40.507143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfabd5-7183-41ef-9ca4-63d82d62e0cf None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:40.507441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfabd5-7183-41ef-9ca4-63d82d62e0cf None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:40.507705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfabd5-7183-41ef-9ca4-63d82d62e0cf None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:40.509452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 690/1378] 10.222.0.67 () {54 vars in 918 bytes} [Thu Dec 16 14:31:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:40.515041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371c34e-3694-4711-8e39-2417c0157811 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:40.515332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371c34e-3694-4711-8e39-2417c0157811 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:40.515614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371c34e-3694-4711-8e39-2417c0157811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:40.540178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3371c34e-3694-4711-8e39-2417c0157811 None None] MFA Rules not processed for user `f2bcc9f013f14ed89f5e94591f170b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:40.541317 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3371c34e-3694-4711-8e39-2417c0157811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:40.551260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 689/1379] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Dec 16 14:31:40 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:42.972727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f97e1-807e-4998-b23b-2d26460bfbd6 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:42.973365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f97e1-807e-4998-b23b-2d26460bfbd6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:42.973365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f97e1-807e-4998-b23b-2d26460bfbd6 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:42.975091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 691/1380] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:31:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:31:42.980985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed659-bae2-4885-b76c-bde9cc372252 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:42.981549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed659-bae2-4885-b76c-bde9cc372252 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:42.981808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed659-bae2-4885-b76c-bde9cc372252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:43.007906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-ea1ed659-bae2-4885-b76c-bde9cc372252 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:43.009108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ea1ed659-bae2-4885-b76c-bde9cc372252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:43.019305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 690/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:31:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:43.109930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f97e1-807e-4998-b23b-2d26460bfbd6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:43.124878 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f97e1-807e-4998-b23b-2d26460bfbd6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:43.130128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0f80b-d7da-4db2-b1f3-d1b5dda30186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:43.130721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0f80b-d7da-4db2-b1f3-d1b5dda30186 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:43.131007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0f80b-d7da-4db2-b1f3-d1b5dda30186 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:43.131284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0f80b-d7da-4db2-b1f3-d1b5dda30186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:43.140738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0f80b-d7da-4db2-b1f3-d1b5dda30186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:43.166168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0f80b-d7da-4db2-b1f3-d1b5dda30186 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:43.176520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 692/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:44.583930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ec1d-afce-4b38-b4bb-e20ba68738b7 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:44.584489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ec1d-afce-4b38-b4bb-e20ba68738b7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:44.584489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ec1d-afce-4b38-b4bb-e20ba68738b7 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:44.586194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 691/1383] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:31:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:44.592423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec90f8-1a08-4751-ab46-f5a22d0c8ad3 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:44.593150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec90f8-1a08-4751-ab46-f5a22d0c8ad3 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:44.593150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec90f8-1a08-4751-ab46-f5a22d0c8ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:44.622427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-66ec90f8-1a08-4751-ab46-f5a22d0c8ad3 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:44.623778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-66ec90f8-1a08-4751-ab46-f5a22d0c8ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:44.632296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 693/1384] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:31:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:44.783147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ec1d-afce-4b38-b4bb-e20ba68738b7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:44.798532 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ec1d-afce-4b38-b4bb-e20ba68738b7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:44.804298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0477f-52c3-4a53-af6d-a0e65696b2bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:44.805282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0477f-52c3-4a53-af6d-a0e65696b2bf service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:44.805774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0477f-52c3-4a53-af6d-a0e65696b2bf service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:44.806313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0477f-52c3-4a53-af6d-a0e65696b2bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:44.817065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0477f-52c3-4a53-af6d-a0e65696b2bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:44.843271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0477f-52c3-4a53-af6d-a0e65696b2bf service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:44.853654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 692/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:31:46.342087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b76f9-c15e-42db-9720-a8b980aa3eac None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:46.342705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b76f9-c15e-42db-9720-a8b980aa3eac None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:46.342705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b76f9-c15e-42db-9720-a8b980aa3eac None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:46.344478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 694/1386] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:31:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:46.350368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582f45-6eb6-4769-8c33-13bc9723ac8c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:46.350948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582f45-6eb6-4769-8c33-13bc9723ac8c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:46.350948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee582f45-6eb6-4769-8c33-13bc9723ac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:46.374811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-ee582f45-6eb6-4769-8c33-13bc9723ac8c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:46.376180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ee582f45-6eb6-4769-8c33-13bc9723ac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:46.383471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 693/1387] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:31:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:46.536205 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b76f9-c15e-42db-9720-a8b980aa3eac None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:46.552264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b76f9-c15e-42db-9720-a8b980aa3eac None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:46.557743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b709f2-25a0-46d5-9dcb-fbaca20080e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:46.558375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b709f2-25a0-46d5-9dcb-fbaca20080e3 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:46.558657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b709f2-25a0-46d5-9dcb-fbaca20080e3 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:46.558933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b709f2-25a0-46d5-9dcb-fbaca20080e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:46.568744 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b709f2-25a0-46d5-9dcb-fbaca20080e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:46.595535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b709f2-25a0-46d5-9dcb-fbaca20080e3 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:46.606629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 695/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:48.080068 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52cd1e-db41-44c0-869b-df16906d4b9e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:48.080670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52cd1e-db41-44c0-869b-df16906d4b9e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:48.080670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52cd1e-db41-44c0-869b-df16906d4b9e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:48.082492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 694/1389] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:31:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:48.088526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd0948-81c2-4dc0-9e90-06602955499b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:48.089145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd0948-81c2-4dc0-9e90-06602955499b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:48.089145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd0948-81c2-4dc0-9e90-06602955499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:48.114357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b1fd0948-81c2-4dc0-9e90-06602955499b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:48.115588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b1fd0948-81c2-4dc0-9e90-06602955499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:48.126098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 696/1390] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:31:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:48.275935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52cd1e-db41-44c0-869b-df16906d4b9e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:48.290087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52cd1e-db41-44c0-869b-df16906d4b9e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:48.295248 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46b2e4-dea7-41e5-b9d6-c3406c1cf003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:48.295922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46b2e4-dea7-41e5-b9d6-c3406c1cf003 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:48.296198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46b2e4-dea7-41e5-b9d6-c3406c1cf003 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:48.296477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46b2e4-dea7-41e5-b9d6-c3406c1cf003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:48.306119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46b2e4-dea7-41e5-b9d6-c3406c1cf003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:48.333292 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46b2e4-dea7-41e5-b9d6-c3406c1cf003 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:48.346932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 695/1391] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:49.823480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9540-babc-4fcb-8deb-bf8f293c9a4e None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:49.824071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9540-babc-4fcb-8deb-bf8f293c9a4e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:49.824071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9540-babc-4fcb-8deb-bf8f293c9a4e None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:49.825760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 697/1392] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:31:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:49.831443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1471e-7014-402b-8e52-4a35520386f7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:49.831962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1471e-7014-402b-8e52-4a35520386f7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:49.832058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1471e-7014-402b-8e52-4a35520386f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:49.855931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-52a1471e-7014-402b-8e52-4a35520386f7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:49.857083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-52a1471e-7014-402b-8e52-4a35520386f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:49.865726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 696/1393] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:31:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:31:50.017025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9540-babc-4fcb-8deb-bf8f293c9a4e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:50.032047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9540-babc-4fcb-8deb-bf8f293c9a4e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:50.037513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c7eef-fcd6-4447-ad5a-c1673da2d91e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:50.038128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c7eef-fcd6-4447-ad5a-c1673da2d91e service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:50.038418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c7eef-fcd6-4447-ad5a-c1673da2d91e service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:50.038697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c7eef-fcd6-4447-ad5a-c1673da2d91e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:50.048067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c7eef-fcd6-4447-ad5a-c1673da2d91e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:50.074061 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c7eef-fcd6-4447-ad5a-c1673da2d91e service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:50.084270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 698/1394] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:51.498286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685815-c974-481d-b9fc-0e532db928f8 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:51.498963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685815-c974-481d-b9fc-0e532db928f8 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:51.498963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685815-c974-481d-b9fc-0e532db928f8 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:51.500679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 697/1395] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:31:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:51.506889 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b983a-d308-4d34-b404-fc06de478192 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:51.507482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b983a-d308-4d34-b404-fc06de478192 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:51.507762 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b983a-d308-4d34-b404-fc06de478192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:51.533328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-944b983a-d308-4d34-b404-fc06de478192 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:51.534513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-944b983a-d308-4d34-b404-fc06de478192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:51.542577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 699/1396] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:31:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:51.693677 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0685815-c974-481d-b9fc-0e532db928f8 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:51.710269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0685815-c974-481d-b9fc-0e532db928f8 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:51.715473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b78675-0999-4bd0-9997-a6dfb782afb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:51.716060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b78675-0999-4bd0-9997-a6dfb782afb4 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:51.716370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b78675-0999-4bd0-9997-a6dfb782afb4 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:51.716652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b78675-0999-4bd0-9997-a6dfb782afb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:51.725859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b78675-0999-4bd0-9997-a6dfb782afb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:51.751873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b78675-0999-4bd0-9997-a6dfb782afb4 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:51.762313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 698/1397] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:31:53.154655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaf63c-c5f5-4694-8b5c-744d60211485 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:53.155760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaf63c-c5f5-4694-8b5c-744d60211485 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:53.155760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaf63c-c5f5-4694-8b5c-744d60211485 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:53.157095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 700/1398] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:31:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:31:53.162779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d9d6e-158e-49dc-aa05-8d5cfaf943c5 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:53.163294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d9d6e-158e-49dc-aa05-8d5cfaf943c5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:53.163418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d9d6e-158e-49dc-aa05-8d5cfaf943c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:53.187785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-1a4d9d6e-158e-49dc-aa05-8d5cfaf943c5 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:53.188962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1a4d9d6e-158e-49dc-aa05-8d5cfaf943c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:53.196289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 699/1399] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:31:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:31:53.354209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaf63c-c5f5-4694-8b5c-744d60211485 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:53.368382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaf63c-c5f5-4694-8b5c-744d60211485 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:53.373298 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a38d3-df3d-48c1-96c3-c858fddd96a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:53.373907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a38d3-df3d-48c1-96c3-c858fddd96a9 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:53.374300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a38d3-df3d-48c1-96c3-c858fddd96a9 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:53.374575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a38d3-df3d-48c1-96c3-c858fddd96a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:53.383374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a38d3-df3d-48c1-96c3-c858fddd96a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:53.409270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a38d3-df3d-48c1-96c3-c858fddd96a9 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:53.419076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 701/1400] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:54.824220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcb7da-671e-4293-a78b-a9e9978c0231 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:54.824805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcb7da-671e-4293-a78b-a9e9978c0231 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:54.824805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcb7da-671e-4293-a78b-a9e9978c0231 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:54.826415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 700/1401] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:31:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:54.831750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed07c-a476-413d-8896-018ed5ce042f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:54.832249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed07c-a476-413d-8896-018ed5ce042f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:54.832374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed07c-a476-413d-8896-018ed5ce042f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:54.857909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-aa4ed07c-a476-413d-8896-018ed5ce042f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:54.859153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-aa4ed07c-a476-413d-8896-018ed5ce042f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:54.867720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 702/1402] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:31:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:55.020295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcb7da-671e-4293-a78b-a9e9978c0231 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:55.034719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcb7da-671e-4293-a78b-a9e9978c0231 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:55.040229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213ebfd-317b-4e0b-bc2b-b6e69776642f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:55.040810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ebfd-317b-4e0b-bc2b-b6e69776642f service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:55.041090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ebfd-317b-4e0b-bc2b-b6e69776642f service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:55.041364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ebfd-317b-4e0b-bc2b-b6e69776642f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:55.050284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213ebfd-317b-4e0b-bc2b-b6e69776642f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:55.076585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213ebfd-317b-4e0b-bc2b-b6e69776642f service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:55.087077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 701/1403] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:56.459191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf403912-cdc4-478e-bcc3-6a148aeac767 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:56.459740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf403912-cdc4-478e-bcc3-6a148aeac767 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:56.459740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf403912-cdc4-478e-bcc3-6a148aeac767 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:56.461345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 703/1404] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:31:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:56.467083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8fa4a-5f7e-4dbd-9e73-050418b8dde2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:56.467500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8fa4a-5f7e-4dbd-9e73-050418b8dde2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:56.467731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8fa4a-5f7e-4dbd-9e73-050418b8dde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:56.492004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-1db8fa4a-5f7e-4dbd-9e73-050418b8dde2 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:56.493291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1db8fa4a-5f7e-4dbd-9e73-050418b8dde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:56.500767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 702/1405] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:31:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:31:56.649697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf403912-cdc4-478e-bcc3-6a148aeac767 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:56.664537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf403912-cdc4-478e-bcc3-6a148aeac767 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:56.669813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf674e-a745-4a70-99cd-47b119d66713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:56.670589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf674e-a745-4a70-99cd-47b119d66713 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:56.671046 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf674e-a745-4a70-99cd-47b119d66713 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:56.671487 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf674e-a745-4a70-99cd-47b119d66713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:56.680269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf674e-a745-4a70-99cd-47b119d66713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:56.706182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf674e-a745-4a70-99cd-47b119d66713 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:56.716244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 704/1406] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:31:58.816049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54ebb-d9cf-4bee-83d9-41b1d7192271 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:58.816612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54ebb-d9cf-4bee-83d9-41b1d7192271 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:58.816612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc54ebb-d9cf-4bee-83d9-41b1d7192271 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:58.818790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 703/1407] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:31:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:31:58.825898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf9d3f-290b-4988-b15d-89e01d02a02a None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:58.826545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf9d3f-290b-4988-b15d-89e01d02a02a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:58.826662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf9d3f-290b-4988-b15d-89e01d02a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:58.853837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-daaf9d3f-290b-4988-b15d-89e01d02a02a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:31:58.855045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-daaf9d3f-290b-4988-b15d-89e01d02a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:31:58.864535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 705/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:31:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:31:58.906044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54ebb-d9cf-4bee-83d9-41b1d7192271 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:31:58.924254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc54ebb-d9cf-4bee-83d9-41b1d7192271 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:31:58.928484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ce5d8-5fa9-48f4-ac7b-59404ca0e06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:31:58.929176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce5d8-5fa9-48f4-ac7b-59404ca0e06a service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:31:58.929512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce5d8-5fa9-48f4-ac7b-59404ca0e06a service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:31:58.929854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce5d8-5fa9-48f4-ac7b-59404ca0e06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:31:58.941492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ce5d8-5fa9-48f4-ac7b-59404ca0e06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:31:58.974094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ce5d8-5fa9-48f4-ac7b-59404ca0e06a service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:31:58.986531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 704/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:31:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:01.234117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af682642-0985-4d48-a38a-cca152ce8986 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:01.234920 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af682642-0985-4d48-a38a-cca152ce8986 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:01.234920 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af682642-0985-4d48-a38a-cca152ce8986 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:01.236475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 706/1410] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:32:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:01.242820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d87177-6ee2-4867-a2b6-9fe450fcad21 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:01.243431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d87177-6ee2-4867-a2b6-9fe450fcad21 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:01.243431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d87177-6ee2-4867-a2b6-9fe450fcad21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:01.269722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-31d87177-6ee2-4867-a2b6-9fe450fcad21 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:01.270923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-31d87177-6ee2-4867-a2b6-9fe450fcad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:01.278470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 705/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:32:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:01.321811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af682642-0985-4d48-a38a-cca152ce8986 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:01.333066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af682642-0985-4d48-a38a-cca152ce8986 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:01.337938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e4a7c-9398-46df-a663-2ac5bafd4c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:01.338944 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e4a7c-9398-46df-a663-2ac5bafd4c94 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:01.339466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e4a7c-9398-46df-a663-2ac5bafd4c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:01.339960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e4a7c-9398-46df-a663-2ac5bafd4c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:01.352931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e4a7c-9398-46df-a663-2ac5bafd4c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:01.385778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e4a7c-9398-46df-a663-2ac5bafd4c94 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:01.398992 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 707/1412] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:03.949459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f3328-0386-441c-8e4e-5c15aeef88d2 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:03.950088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f3328-0386-441c-8e4e-5c15aeef88d2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:03.950088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f3328-0386-441c-8e4e-5c15aeef88d2 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:03.951737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 706/1413] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:32:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:03.957280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168cf39-3b3e-42ed-886f-38e0f8cedbb0 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:03.957752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168cf39-3b3e-42ed-886f-38e0f8cedbb0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:03.957853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168cf39-3b3e-42ed-886f-38e0f8cedbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:03.981855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-7168cf39-3b3e-42ed-886f-38e0f8cedbb0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:03.983045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7168cf39-3b3e-42ed-886f-38e0f8cedbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:03.990853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 708/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:32:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:04.031832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f3328-0386-441c-8e4e-5c15aeef88d2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:04.043281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f3328-0386-441c-8e4e-5c15aeef88d2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:04.049876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536713f-e15b-4f9f-bb1c-a23c0a53e4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:04.049876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536713f-e15b-4f9f-bb1c-a23c0a53e4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:04.049876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536713f-e15b-4f9f-bb1c-a23c0a53e4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:04.049876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536713f-e15b-4f9f-bb1c-a23c0a53e4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:04.060158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536713f-e15b-4f9f-bb1c-a23c0a53e4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:04.087048 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536713f-e15b-4f9f-bb1c-a23c0a53e4c4 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:04.097445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 707/1415] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:06.228691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34294678-0b86-4120-99e5-c00053cb8d96 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:06.229365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34294678-0b86-4120-99e5-c00053cb8d96 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:06.229365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34294678-0b86-4120-99e5-c00053cb8d96 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:06.231901 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 709/1416] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:32:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:06.239524 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca22631-41dd-4622-991d-e4d1f79d10ae None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:06.240131 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca22631-41dd-4622-991d-e4d1f79d10ae None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:06.240131 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca22631-41dd-4622-991d-e4d1f79d10ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:06.264868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9ca22631-41dd-4622-991d-e4d1f79d10ae None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:06.266516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9ca22631-41dd-4622-991d-e4d1f79d10ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:06.276835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 708/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:32:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:06.316034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34294678-0b86-4120-99e5-c00053cb8d96 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:06.330113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34294678-0b86-4120-99e5-c00053cb8d96 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:06.335229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198c5eb-bcdc-4b0c-be39-2cba447b98a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:06.335898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c5eb-bcdc-4b0c-be39-2cba447b98a3 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:06.336557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c5eb-bcdc-4b0c-be39-2cba447b98a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:06.336855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c5eb-bcdc-4b0c-be39-2cba447b98a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:06.350540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198c5eb-bcdc-4b0c-be39-2cba447b98a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:06.376097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198c5eb-bcdc-4b0c-be39-2cba447b98a3 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:06.386504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 710/1418] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:08.833568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0db8-ceb9-47ae-8170-7de1358974f9 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:08.834183 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0db8-ceb9-47ae-8170-7de1358974f9 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:08.834183 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0db8-ceb9-47ae-8170-7de1358974f9 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:08.837598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 709/1419] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:32:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:08.843790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a5c46-50d2-4da3-ab20-4b3af6d4cc03 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:08.844353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a5c46-50d2-4da3-ab20-4b3af6d4cc03 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:08.844353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a5c46-50d2-4da3-ab20-4b3af6d4cc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:08.867727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-f86a5c46-50d2-4da3-ab20-4b3af6d4cc03 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:08.868895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f86a5c46-50d2-4da3-ab20-4b3af6d4cc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:08.876369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 711/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:32:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:08.915214 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a0db8-ceb9-47ae-8170-7de1358974f9 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:08.927159 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a0db8-ceb9-47ae-8170-7de1358974f9 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:08.931173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306e245-6e3d-41f0-8421-639d651efc8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:08.931768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e245-6e3d-41f0-8421-639d651efc8a service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:08.932051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e245-6e3d-41f0-8421-639d651efc8a service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:08.932329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e245-6e3d-41f0-8421-639d651efc8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:08.942570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e245-6e3d-41f0-8421-639d651efc8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:08.967906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e245-6e3d-41f0-8421-639d651efc8a service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:08.978797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 710/1421] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:32:11.153487 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef4a8e-c313-473a-b035-712ddb9c2463 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:11.154130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef4a8e-c313-473a-b035-712ddb9c2463 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:11.154130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef4a8e-c313-473a-b035-712ddb9c2463 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:11.155794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 712/1422] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:32:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:11.161844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37689134-ed04-4ea4-8986-8abe0e7f7910 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:11.162379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37689134-ed04-4ea4-8986-8abe0e7f7910 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:11.162489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37689134-ed04-4ea4-8986-8abe0e7f7910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:11.185978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-37689134-ed04-4ea4-8986-8abe0e7f7910 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:11.187514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-37689134-ed04-4ea4-8986-8abe0e7f7910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:11.194952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 711/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:32:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:11.233268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef4a8e-c313-473a-b035-712ddb9c2463 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:11.244798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef4a8e-c313-473a-b035-712ddb9c2463 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:11.248718 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dd807-2084-452b-b2a1-12a4267861f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:11.249292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dd807-2084-452b-b2a1-12a4267861f9 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:11.249575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dd807-2084-452b-b2a1-12a4267861f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:11.249847 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dd807-2084-452b-b2a1-12a4267861f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:11.261133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dd807-2084-452b-b2a1-12a4267861f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:11.287378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dd807-2084-452b-b2a1-12a4267861f9 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:11.298778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 713/1424] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:13.416611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b903534-0882-4bb8-9d31-122390a3cbd0 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:13.417153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b903534-0882-4bb8-9d31-122390a3cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:13.417153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b903534-0882-4bb8-9d31-122390a3cbd0 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:13.418819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 712/1425] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:32:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:13.424473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3705a6-a5cd-4562-8ae1-1f9e368c85c8 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:13.424971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3705a6-a5cd-4562-8ae1-1f9e368c85c8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:13.425091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3705a6-a5cd-4562-8ae1-1f9e368c85c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:13.449204 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-7c3705a6-a5cd-4562-8ae1-1f9e368c85c8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:13.450387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7c3705a6-a5cd-4562-8ae1-1f9e368c85c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:13.458125 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 714/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:32:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:32:13.498971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b903534-0882-4bb8-9d31-122390a3cbd0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:13.512143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b903534-0882-4bb8-9d31-122390a3cbd0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:13.515749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b12182-6a82-4ab6-a414-1d0c9b98c6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:13.516555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12182-6a82-4ab6-a414-1d0c9b98c6cd service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:13.517187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12182-6a82-4ab6-a414-1d0c9b98c6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:13.517485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12182-6a82-4ab6-a414-1d0c9b98c6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:13.527902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b12182-6a82-4ab6-a414-1d0c9b98c6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:13.554161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b12182-6a82-4ab6-a414-1d0c9b98c6cd service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:13.565114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 713/1427] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:15.667190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514b41-f9f0-41d4-bfa9-1613c6a061d7 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:15.667757 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514b41-f9f0-41d4-bfa9-1613c6a061d7 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:15.667757 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514b41-f9f0-41d4-bfa9-1613c6a061d7 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:15.669450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 715/1428] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:32:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:32:15.675240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4465-9604-4ec1-8e1b-df95dda66815 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:15.675687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4465-9604-4ec1-8e1b-df95dda66815 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:15.675825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4465-9604-4ec1-8e1b-df95dda66815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:15.700694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f4eb4465-9604-4ec1-8e1b-df95dda66815 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:15.701839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f4eb4465-9604-4ec1-8e1b-df95dda66815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:15.710118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 714/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:32:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:15.747500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514b41-f9f0-41d4-bfa9-1613c6a061d7 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:15.759500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514b41-f9f0-41d4-bfa9-1613c6a061d7 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:15.763038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d07561-7756-4ffe-8c27-7d0de6dc9012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:15.763626 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d07561-7756-4ffe-8c27-7d0de6dc9012 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:15.763907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d07561-7756-4ffe-8c27-7d0de6dc9012 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:15.764156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d07561-7756-4ffe-8c27-7d0de6dc9012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:15.774794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d07561-7756-4ffe-8c27-7d0de6dc9012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:15.800857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d07561-7756-4ffe-8c27-7d0de6dc9012 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:15.811588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 716/1430] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:18.008100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd288c-cf14-4b87-8fb1-f463c8066ef6 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:18.008704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd288c-cf14-4b87-8fb1-f463c8066ef6 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:18.008704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd288c-cf14-4b87-8fb1-f463c8066ef6 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:18.010374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 715/1431] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:32:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:18.016531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d232e4-ea9f-4fe8-82ea-a1d15cbf4b41 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:18.017364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d232e4-ea9f-4fe8-82ea-a1d15cbf4b41 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:18.017625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d232e4-ea9f-4fe8-82ea-a1d15cbf4b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:18.042656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-37d232e4-ea9f-4fe8-82ea-a1d15cbf4b41 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:18.043840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-37d232e4-ea9f-4fe8-82ea-a1d15cbf4b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:18.052535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 717/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:32:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:18.106454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd288c-cf14-4b87-8fb1-f463c8066ef6 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:18.121503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd288c-cf14-4b87-8fb1-f463c8066ef6 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:18.125022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5372b-28a3-46d5-968f-c88c9b34b28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:18.125738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5372b-28a3-46d5-968f-c88c9b34b28e service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:18.126810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5372b-28a3-46d5-968f-c88c9b34b28e service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:18.127256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5372b-28a3-46d5-968f-c88c9b34b28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:18.138657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5372b-28a3-46d5-968f-c88c9b34b28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:18.167404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5372b-28a3-46d5-968f-c88c9b34b28e service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:18.178324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 716/1433] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:20.273403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb64e7-8413-43cd-9e98-a9bee1bada59 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:20.274039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb64e7-8413-43cd-9e98-a9bee1bada59 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:20.274039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb64e7-8413-43cd-9e98-a9bee1bada59 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:20.275752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 718/1434] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:32:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:20.283871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadff86-9b7d-4713-a667-d276bebde1ad None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:20.284346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadff86-9b7d-4713-a667-d276bebde1ad None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:20.284431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadff86-9b7d-4713-a667-d276bebde1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:20.308375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2fadff86-9b7d-4713-a667-d276bebde1ad None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:20.309527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2fadff86-9b7d-4713-a667-d276bebde1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:20.319764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 717/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:32:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:20.357847 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb64e7-8413-43cd-9e98-a9bee1bada59 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:20.369969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb64e7-8413-43cd-9e98-a9bee1bada59 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:20.373894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cba706-05bc-48f5-af60-a957594e14b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:20.374491 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cba706-05bc-48f5-af60-a957594e14b0 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:20.374773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cba706-05bc-48f5-af60-a957594e14b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:20.375044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cba706-05bc-48f5-af60-a957594e14b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:20.384869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cba706-05bc-48f5-af60-a957594e14b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:20.410701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cba706-05bc-48f5-af60-a957594e14b0 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:20.421227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 719/1436] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:32:33.139830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d331e-833c-498d-9a1a-955ed7ad2a85 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:33.140423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d331e-833c-498d-9a1a-955ed7ad2a85 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:33.140890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d331e-833c-498d-9a1a-955ed7ad2a85 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:33.151229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 718/1437] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:32:33 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:33.157334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532689ee-bc5c-4e00-9035-0b5338464382 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:33.158059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532689ee-bc5c-4e00-9035-0b5338464382 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:33.158059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532689ee-bc5c-4e00-9035-0b5338464382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:33.186512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-532689ee-bc5c-4e00-9035-0b5338464382 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:33.187962 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-532689ee-bc5c-4e00-9035-0b5338464382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:33.196995 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 720/1438] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:33.243845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d331e-833c-498d-9a1a-955ed7ad2a85 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:33.256684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d331e-833c-498d-9a1a-955ed7ad2a85 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:33.260456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e78d58-37f3-4304-83ca-472177580176 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b797c99041b4e9c9cde7d0064013fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:33.261145 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e78d58-37f3-4304-83ca-472177580176 service glance] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:33.261511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e78d58-37f3-4304-83ca-472177580176 service glance] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:33.261890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e78d58-37f3-4304-83ca-472177580176 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:33.273846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e78d58-37f3-4304-83ca-472177580176 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:33.300792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e78d58-37f3-4304-83ca-472177580176 service glance] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:33.311398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 719/1439] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:35.525562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517670d-bb91-45cd-b984-96c06dbb20eb None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:35.526228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517670d-bb91-45cd-b984-96c06dbb20eb None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:35.526228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517670d-bb91-45cd-b984-96c06dbb20eb None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:35.527710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 721/1440] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:32:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:35.533386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edefda-5830-4557-bccd-a8bc3511236e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:35.534071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edefda-5830-4557-bccd-a8bc3511236e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:35.534071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edefda-5830-4557-bccd-a8bc3511236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:35.559648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-99edefda-5830-4557-bccd-a8bc3511236e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:35.561548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-99edefda-5830-4557-bccd-a8bc3511236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:35.571909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 720/1441] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:35.595444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517670d-bb91-45cd-b984-96c06dbb20eb None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:35.609745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517670d-bb91-45cd-b984-96c06dbb20eb None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:35.616848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b5964-caf6-486b-a139-9ad016af09ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:35.617541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b5964-caf6-486b-a139-9ad016af09ee admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:35.617923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b5964-caf6-486b-a139-9ad016af09ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:35.618334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b5964-caf6-486b-a139-9ad016af09ee admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:35.619165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b5964-caf6-486b-a139-9ad016af09ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:35.645787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b5964-caf6-486b-a139-9ad016af09ee admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:35.663000 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 722/1442] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Dec 16 14:32:35 2021] GET /identity/v3/projects => generated 2553 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:32:37.219885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97928c9-031f-45cd-a22d-1788fa5ad7d3 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:37.220470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97928c9-031f-45cd-a22d-1788fa5ad7d3 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:37.220470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97928c9-031f-45cd-a22d-1788fa5ad7d3 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:37.222310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 721/1443] 10.222.0.67 () {54 vars in 911 bytes} [Thu Dec 16 14:32:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:37.227635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecc32-cfd8-4b0a-bb11-97242fe70c21 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:37.228144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecc32-cfd8-4b0a-bb11-97242fe70c21 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:37.228253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecc32-cfd8-4b0a-bb11-97242fe70c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:37.251983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b17ecc32-cfd8-4b0a-bb11-97242fe70c21 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:37.253354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b17ecc32-cfd8-4b0a-bb11-97242fe70c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:37.261649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 723/1444] 10.222.0.67 () {58 vars in 1008 bytes} [Thu Dec 16 14:32:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:37.416408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97928c9-031f-45cd-a22d-1788fa5ad7d3 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:37.434026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97928c9-031f-45cd-a22d-1788fa5ad7d3 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:37.440339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa59dd-b14e-4d3a-8f85-05982672b142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:37.441143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa59dd-b14e-4d3a-8f85-05982672b142 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:37.441432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa59dd-b14e-4d3a-8f85-05982672b142 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:37.441734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa59dd-b14e-4d3a-8f85-05982672b142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:37.450590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa59dd-b14e-4d3a-8f85-05982672b142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:37.477470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa59dd-b14e-4d3a-8f85-05982672b142 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:37.488972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 722/1445] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:39.608820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270aac1-563d-440b-83df-fe98fb995589 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:39.609430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270aac1-563d-440b-83df-fe98fb995589 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:39.609430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270aac1-563d-440b-83df-fe98fb995589 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:39.611216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 724/1446] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:32:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:39.617275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e0cb-eaa0-465c-9572-d42943ec70e0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:39.617806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e0cb-eaa0-465c-9572-d42943ec70e0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:39.617919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e0cb-eaa0-465c-9572-d42943ec70e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:39.644005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-6f09e0cb-eaa0-465c-9572-d42943ec70e0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:39.645200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-6f09e0cb-eaa0-465c-9572-d42943ec70e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:39.655887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 723/1447] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:39.694384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270aac1-563d-440b-83df-fe98fb995589 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:39.706149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270aac1-563d-440b-83df-fe98fb995589 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:39.709736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998d2ce-b6f1-4429-ad7f-fe655bd8b209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:39.710475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998d2ce-b6f1-4429-ad7f-fe655bd8b209 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:39.710760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998d2ce-b6f1-4429-ad7f-fe655bd8b209 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:39.711036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998d2ce-b6f1-4429-ad7f-fe655bd8b209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:39.720790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998d2ce-b6f1-4429-ad7f-fe655bd8b209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:39.746424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998d2ce-b6f1-4429-ad7f-fe655bd8b209 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:39.756887 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 725/1448] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:41.852741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891df222-2b90-448d-ad79-35b931501fe4 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:41.854262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891df222-2b90-448d-ad79-35b931501fe4 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:41.854573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891df222-2b90-448d-ad79-35b931501fe4 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:41.856339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 724/1449] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:32:41 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:41.862705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc45d61-4a7a-49c5-97d0-5239685a4036 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:41.863390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc45d61-4a7a-49c5-97d0-5239685a4036 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:41.863390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc45d61-4a7a-49c5-97d0-5239685a4036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:41.886637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-efc45d61-4a7a-49c5-97d0-5239685a4036 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:41.887785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-efc45d61-4a7a-49c5-97d0-5239685a4036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:41.895949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 726/1450] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:41.935823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891df222-2b90-448d-ad79-35b931501fe4 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:41.948614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891df222-2b90-448d-ad79-35b931501fe4 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:41.952562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86d713-163f-406c-9812-529c8ef23017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:41.953206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d713-163f-406c-9812-529c8ef23017 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:41.953493 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d713-163f-406c-9812-529c8ef23017 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:41.953808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d713-163f-406c-9812-529c8ef23017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:41.965473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86d713-163f-406c-9812-529c8ef23017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:41.994717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86d713-163f-406c-9812-529c8ef23017 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:42.006671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 725/1451] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:44.327581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a4769-3149-4174-a925-e9b47e05883e None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:44.328188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a4769-3149-4174-a925-e9b47e05883e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:44.328188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a4769-3149-4174-a925-e9b47e05883e None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:44.329846 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 727/1452] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:32:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:44.335917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f04e-1b7c-4842-87fc-495f4fc302a7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:44.336461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f04e-1b7c-4842-87fc-495f4fc302a7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:44.336461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f04e-1b7c-4842-87fc-495f4fc302a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:44.363658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-7e65f04e-1b7c-4842-87fc-495f4fc302a7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:44.364817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7e65f04e-1b7c-4842-87fc-495f4fc302a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:44.372230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 726/1453] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:44.415780 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a4769-3149-4174-a925-e9b47e05883e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:44.430200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a4769-3149-4174-a925-e9b47e05883e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:44.434683 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c044181-0233-456e-84bb-bc07f45e9812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:44.435329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c044181-0233-456e-84bb-bc07f45e9812 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:44.435624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c044181-0233-456e-84bb-bc07f45e9812 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:44.435931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c044181-0233-456e-84bb-bc07f45e9812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:44.448276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c044181-0233-456e-84bb-bc07f45e9812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:44.474521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c044181-0233-456e-84bb-bc07f45e9812 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:44.484679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 728/1454] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:32:46.877706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbadcd-aa42-4742-82b2-9fc00d0d6210 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:46.878438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbadcd-aa42-4742-82b2-9fc00d0d6210 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:46.878438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbadcd-aa42-4742-82b2-9fc00d0d6210 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:46.880256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 727/1455] 10.222.0.67 () {54 vars in 926 bytes} [Thu Dec 16 14:32:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:32:46.886127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2777492-315c-4ba2-9856-1371b74250a4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:46.886672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2777492-315c-4ba2-9856-1371b74250a4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:46.886672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2777492-315c-4ba2-9856-1371b74250a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:46.911821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c2777492-315c-4ba2-9856-1371b74250a4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:32:46.912998 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c2777492-315c-4ba2-9856-1371b74250a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:32:46.920122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 729/1456] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Dec 16 14:32:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:32:46.959963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbadcd-aa42-4742-82b2-9fc00d0d6210 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:32:46.972318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbadcd-aa42-4742-82b2-9fc00d0d6210 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:32:46.976313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c35e9-9c46-4e15-9db2-6b78641aec03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:32:46.976904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c35e9-9c46-4e15-9db2-6b78641aec03 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:32:46.977185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c35e9-9c46-4e15-9db2-6b78641aec03 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:32:46.977445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c35e9-9c46-4e15-9db2-6b78641aec03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:32:46.988195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c35e9-9c46-4e15-9db2-6b78641aec03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:32:47.015782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c35e9-9c46-4e15-9db2-6b78641aec03 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:32:47.026845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 728/1457] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:32:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:34:01.741106 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9745-daa9-4fb1-9ac9-86d4705fef45 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:01.741699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9745-daa9-4fb1-9ac9-86d4705fef45 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:01.741699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9745-daa9-4fb1-9ac9-86d4705fef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:01.767001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-e51c9745-daa9-4fb1-9ac9-86d4705fef45 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:01.768169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e51c9745-daa9-4fb1-9ac9-86d4705fef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:01.775806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 730/1458] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:34:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:34:01.784382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0135636-80c4-43cf-80ac-01a336ec8177 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:01.784976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0135636-80c4-43cf-80ac-01a336ec8177 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:01.784976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0135636-80c4-43cf-80ac-01a336ec8177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:01.810020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e0135636-80c4-43cf-80ac-01a336ec8177 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:01.811254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e0135636-80c4-43cf-80ac-01a336ec8177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:01.819760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 729/1459] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:34:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:34:01.825737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9745-daa9-4fb1-9ac9-86d4705fef45 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:01.835360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9745-daa9-4fb1-9ac9-86d4705fef45 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:01.840425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f255-5486-475a-82f9-2cf4f628ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:01.841027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f255-5486-475a-82f9-2cf4f628ac8d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:01.841307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f255-5486-475a-82f9-2cf4f628ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:01.841585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f255-5486-475a-82f9-2cf4f628ac8d admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:01.842312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7f255-5486-475a-82f9-2cf4f628ac8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:34:01.842611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7f255-5486-475a-82f9-2cf4f628ac8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:34:01.875839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7f255-5486-475a-82f9-2cf4f628ac8d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:01.896352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 731/1460] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:34:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:34:01.905406 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0135636-80c4-43cf-80ac-01a336ec8177 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:01.914779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0135636-80c4-43cf-80ac-01a336ec8177 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:01.920184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9698d7d-60cf-4ded-8cc2-f4a863a0cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:01.920809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698d7d-60cf-4ded-8cc2-f4a863a0cc0a admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:01.921087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698d7d-60cf-4ded-8cc2-f4a863a0cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:01.921367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698d7d-60cf-4ded-8cc2-f4a863a0cc0a admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:01.922109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698d7d-60cf-4ded-8cc2-f4a863a0cc0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:34:01.954433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698d7d-60cf-4ded-8cc2-f4a863a0cc0a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:01.998150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 730/1461] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:34:01 2021] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:34:02.000485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f255-5486-475a-82f9-2cf4f628ac8d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:02.011867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f255-5486-475a-82f9-2cf4f628ac8d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:02.083547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecd634-c663-44d2-acb3-4072dba5f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:02.084159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecd634-c663-44d2-acb3-4072dba5f9bb admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:02.084441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecd634-c663-44d2-acb3-4072dba5f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:02.084702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecd634-c663-44d2-acb3-4072dba5f9bb admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:02.085351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecd634-c663-44d2-acb3-4072dba5f9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:34:02.111075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecd634-c663-44d2-acb3-4072dba5f9bb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:02.134157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 732/1462] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:34:01 2021] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:34:02.139122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9698d7d-60cf-4ded-8cc2-f4a863a0cc0a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:02.149719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9698d7d-60cf-4ded-8cc2-f4a863a0cc0a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:02.154683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda0eac-702d-4d1a-9c6b-1911199f5125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:02.156370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0eac-702d-4d1a-9c6b-1911199f5125 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:02.156370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0eac-702d-4d1a-9c6b-1911199f5125 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:02.156370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0eac-702d-4d1a-9c6b-1911199f5125 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:02.156370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda0eac-702d-4d1a-9c6b-1911199f5125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:34:02.182473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda0eac-702d-4d1a-9c6b-1911199f5125 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:02.194318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 731/1463] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:34:02.199671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecd634-c663-44d2-acb3-4072dba5f9bb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:02.210055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecd634-c663-44d2-acb3-4072dba5f9bb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:02.215427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970df12f-cbd4-4fed-8d57-f5b3150c0b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:02.216282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970df12f-cbd4-4fed-8d57-f5b3150c0b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:02.216565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970df12f-cbd4-4fed-8d57-f5b3150c0b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:02.216844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970df12f-cbd4-4fed-8d57-f5b3150c0b9e admin admin] PATH_INFO: `/v3/projects/679b9ce2113c4f859e8434b08555feb0/users/b9be695a2cd145bd97ba24090f94a8e8/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:02.239539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970df12f-cbd4-4fed-8d57-f5b3150c0b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=679b9ce2113c4f859e8434b08555feb0, user_id=b9be695a2cd145bd97ba24090f94a8e8, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:34:02.265816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970df12f-cbd4-4fed-8d57-f5b3150c0b9e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:02.281138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 733/1464] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:34:02 2021] PUT /identity/v3/projects/679b9ce2113c4f859e8434b08555feb0/users/b9be695a2cd145bd97ba24090f94a8e8/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:34:02.292952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b573-f44e-4aa3-a22d-2fb0e8713c95 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:02.293266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b573-f44e-4aa3-a22d-2fb0e8713c95 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:02.293548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b573-f44e-4aa3-a22d-2fb0e8713c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:02.332445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-12e4b573-f44e-4aa3-a22d-2fb0e8713c95 None None] MFA Rules not processed for user `b9be695a2cd145bd97ba24090f94a8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:02.333610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-12e4b573-f44e-4aa3-a22d-2fb0e8713c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:02.414727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 732/1465] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:34:02 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:34:02.425949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970df12f-cbd4-4fed-8d57-f5b3150c0b9e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:02.504285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970df12f-cbd4-4fed-8d57-f5b3150c0b9e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:02.510643 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77918213-9ba8-45c8-91de-5554a749e5ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:02.511363 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77918213-9ba8-45c8-91de-5554a749e5ba service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:02.511655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77918213-9ba8-45c8-91de-5554a749e5ba service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:02.511935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77918213-9ba8-45c8-91de-5554a749e5ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:02.522801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77918213-9ba8-45c8-91de-5554a749e5ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:34:02.549772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77918213-9ba8-45c8-91de-5554a749e5ba service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:02.563764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 734/1466] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:34:02 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:34:02.646529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a889-a3b9-4642-a039-3a5be2054177 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:02.646797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a889-a3b9-4642-a039-3a5be2054177 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:02.647079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a889-a3b9-4642-a039-3a5be2054177 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:02.648773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 733/1467] 10.222.0.67 () {52 vars in 829 bytes} [Thu Dec 16 14:34:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:34:02.653081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77918213-9ba8-45c8-91de-5554a749e5ba service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:02.727234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77918213-9ba8-45c8-91de-5554a749e5ba service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:02.732734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:02.733560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:02.734448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:02.734448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] PATH_INFO: `/v3/users/b9be695a2cd145bd97ba24090f94a8e8` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:02.735332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9be695a2cd145bd97ba24090f94a8e8)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:34:02.765974 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:34:02.765974 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:34:02.765974 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:34:02.767812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:02.838735 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9be695a2cd145bd97ba24090f94a8e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:02.855610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9be695a2cd145bd97ba24090f94a8e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:02.865185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9be695a2cd145bd97ba24090f94a8e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:02.865891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9be695a2cd145bd97ba24090f94a8e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:02.878220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9be695a2cd145bd97ba24090f94a8e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:02.885327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 735/1468] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:34:02 2021] DELETE /identity/v3/users/b9be695a2cd145bd97ba24090f94a8e8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:34:02.890512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfba295-8101-4402-94ee-c9f28f38c991 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:02.891060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfba295-8101-4402-94ee-c9f28f38c991 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:02.891184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfba295-8101-4402-94ee-c9f28f38c991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:02.913338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-acfba295-8101-4402-94ee-c9f28f38c991 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:34:02.914577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-acfba295-8101-4402-94ee-c9f28f38c991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:02.987477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 734/1469] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:34:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:34:02.999783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:03.001109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:03.076632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293fd1b-2e83-46d2-8e36-b82d6811307b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:03.080271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a50f4-5c0d-4d77-b83f-7a20fd4a2e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:03.080877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a50f4-5c0d-4d77-b83f-7a20fd4a2e14 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:03.081171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a50f4-5c0d-4d77-b83f-7a20fd4a2e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:03.081455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a50f4-5c0d-4d77-b83f-7a20fd4a2e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:03.091649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a50f4-5c0d-4d77-b83f-7a20fd4a2e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:34:03.117154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a50f4-5c0d-4d77-b83f-7a20fd4a2e14 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:03.127761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 736/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:34:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:34:03.582281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfba295-8101-4402-94ee-c9f28f38c991 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:34:03.584325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-acfba295-8101-4402-94ee-c9f28f38c991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:34:03.599769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfba295-8101-4402-94ee-c9f28f38c991 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:34:03.605730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:34:03.606663 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:34:03.607108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:34:03.607526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] PATH_INFO: `/v3/projects/679b9ce2113c4f859e8434b08555feb0` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:34:03.608960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=679b9ce2113c4f859e8434b08555feb0)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:34:03.635894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:34:03.635894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:34:03.635894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:34:03.637108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:34:03.700857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679b9ce2113c4f859e8434b08555feb0', 'request_id': 'req-03d74899-9099-4e06-bc42-a317e8bd2d2e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:03.715883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679b9ce2113c4f859e8434b08555feb0', 'request_id': 'req-03d74899-9099-4e06-bc42-a317e8bd2d2e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:03.725590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679b9ce2113c4f859e8434b08555feb0', 'request_id': 'req-03d74899-9099-4e06-bc42-a317e8bd2d2e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:03.737038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] The token cache is being invalidate because project 679b9ce2113c4f859e8434b08555feb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:34:03.737314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:03.738064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03d74899-9099-4e06-bc42-a317e8bd2d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:34:03.739692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 735/1471] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:34:03 2021] DELETE /identity/v3/projects/679b9ce2113c4f859e8434b08555feb0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:35:35.709591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3b36-fc8b-44f7-88d7-ac0524e03ef5 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:35.710370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3b36-fc8b-44f7-88d7-ac0524e03ef5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:35.710370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3b36-fc8b-44f7-88d7-ac0524e03ef5 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:35.712017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 737/1472] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:35:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:35:35.717155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878d9e9-ff04-457f-bf2b-2ff81594623c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:35.717692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878d9e9-ff04-457f-bf2b-2ff81594623c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:35.717868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878d9e9-ff04-457f-bf2b-2ff81594623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:35.740909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d878d9e9-ff04-457f-bf2b-2ff81594623c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:35.742134 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d878d9e9-ff04-457f-bf2b-2ff81594623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:35.816587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 736/1473] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:35:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:35.831931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74068101-b97c-4052-9fbe-9e8ed37f1d20 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:35.832315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74068101-b97c-4052-9fbe-9e8ed37f1d20 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:35.832636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74068101-b97c-4052-9fbe-9e8ed37f1d20 None None] PATH_INFO: `/v3` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:35.834300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 738/1474] 10.222.0.48 () {54 vars in 925 bytes} [Thu Dec 16 14:35:35 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:35:35.841247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31055e0c-e6e4-4b49-a4c7-7152ecaf7d2e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:35.841559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31055e0c-e6e4-4b49-a4c7-7152ecaf7d2e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:35.841928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31055e0c-e6e4-4b49-a4c7-7152ecaf7d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:35.866525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-31055e0c-e6e4-4b49-a4c7-7152ecaf7d2e None None] MFA Rules not processed for user `15e7b1dc56e949f2adb1744b492187a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:35.867682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-31055e0c-e6e4-4b49-a4c7-7152ecaf7d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:35.949670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 737/1475] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Dec 16 14:35:35 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:35.968935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74068101-b97c-4052-9fbe-9e8ed37f1d20 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:35.970547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-74068101-b97c-4052-9fbe-9e8ed37f1d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:36.055142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74068101-b97c-4052-9fbe-9e8ed37f1d20 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:36.060247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25cf8d-8ee5-4583-b0b7-068287721e86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:36.060856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25cf8d-8ee5-4583-b0b7-068287721e86 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:36.061144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25cf8d-8ee5-4583-b0b7-068287721e86 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:36.061542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25cf8d-8ee5-4583-b0b7-068287721e86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:36.070248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25cf8d-8ee5-4583-b0b7-068287721e86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:35:36.096242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25cf8d-8ee5-4583-b0b7-068287721e86 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:36.106546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 739/1476] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:35:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:35:37.484097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2dc5-ca5c-4caa-b27c-f0d820326b90 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:37.484656 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2dc5-ca5c-4caa-b27c-f0d820326b90 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:37.484757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2dc5-ca5c-4caa-b27c-f0d820326b90 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:37.486451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 738/1477] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:35:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:35:37.491416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d2d70-4ed3-4fcb-8c90-c8ca16989b55 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:37.491865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d2d70-4ed3-4fcb-8c90-c8ca16989b55 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:37.491976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d2d70-4ed3-4fcb-8c90-c8ca16989b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:37.518766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b35d2d70-4ed3-4fcb-8c90-c8ca16989b55 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:37.520752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b35d2d70-4ed3-4fcb-8c90-c8ca16989b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:37.533231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 740/1478] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:35:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:37.690321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2dc5-ca5c-4caa-b27c-f0d820326b90 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:37.707737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2dc5-ca5c-4caa-b27c-f0d820326b90 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:37.713388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5fed8-bf84-4372-9d82-716bd0deb3c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:37.713975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5fed8-bf84-4372-9d82-716bd0deb3c9 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:37.714302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5fed8-bf84-4372-9d82-716bd0deb3c9 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:37.714584 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5fed8-bf84-4372-9d82-716bd0deb3c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:37.723146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5fed8-bf84-4372-9d82-716bd0deb3c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:35:37.749066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5fed8-bf84-4372-9d82-716bd0deb3c9 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:37.759571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 739/1479] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:35:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:35:44.898870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963fe39-8800-4fcb-9a4a-6affcccaee54 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:44.899408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963fe39-8800-4fcb-9a4a-6affcccaee54 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:44.899408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963fe39-8800-4fcb-9a4a-6affcccaee54 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:44.901259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 741/1480] 10.222.0.67 () {54 vars in 960 bytes} [Thu Dec 16 14:35:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:35:44.908578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad3094-54cb-4b7a-8b69-c5806ee28243 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:44.908949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad3094-54cb-4b7a-8b69-c5806ee28243 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:44.909182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad3094-54cb-4b7a-8b69-c5806ee28243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:44.934927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-38ad3094-54cb-4b7a-8b69-c5806ee28243 None None] MFA Rules not processed for user `15e7b1dc56e949f2adb1744b492187a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:44.936132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-38ad3094-54cb-4b7a-8b69-c5806ee28243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:44.944662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 740/1481] 10.222.0.67 () {58 vars in 1057 bytes} [Thu Dec 16 14:35:44 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:44.952862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963fe39-8800-4fcb-9a4a-6affcccaee54 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:44.972685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963fe39-8800-4fcb-9a4a-6affcccaee54 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:44.978348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db45713-0b29-4081-9ca1-abe0acbcf5be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:44.978930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db45713-0b29-4081-9ca1-abe0acbcf5be service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:44.979215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db45713-0b29-4081-9ca1-abe0acbcf5be service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:44.979496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db45713-0b29-4081-9ca1-abe0acbcf5be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:44.987967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db45713-0b29-4081-9ca1-abe0acbcf5be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:35:45.014012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db45713-0b29-4081-9ca1-abe0acbcf5be service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:45.024002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 742/1482] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:35:44 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:35:49.670921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535ea71-6ec9-4402-a836-52916972b2c3 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:49.671569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535ea71-6ec9-4402-a836-52916972b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:49.671569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535ea71-6ec9-4402-a836-52916972b2c3 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:49.673196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 741/1483] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:35:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:35:49.678507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa864248-30a0-4f41-aa67-eb1d8698fca6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:49.679184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa864248-30a0-4f41-aa67-eb1d8698fca6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:49.679184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa864248-30a0-4f41-aa67-eb1d8698fca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:49.704878 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-fa864248-30a0-4f41-aa67-eb1d8698fca6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:49.706104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-fa864248-30a0-4f41-aa67-eb1d8698fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:49.715368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 743/1484] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:35:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:49.931201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535ea71-6ec9-4402-a836-52916972b2c3 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:49.946846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535ea71-6ec9-4402-a836-52916972b2c3 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:49.953139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356e41-90aa-46ba-8c81-4cd053dba5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:49.954165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356e41-90aa-46ba-8c81-4cd053dba5d8 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:49.954471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356e41-90aa-46ba-8c81-4cd053dba5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:49.954797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356e41-90aa-46ba-8c81-4cd053dba5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:49.966118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb356e41-90aa-46ba-8c81-4cd053dba5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:35:49.996356 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb356e41-90aa-46ba-8c81-4cd053dba5d8 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:50.006964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 742/1485] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:35:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:35:51.666763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592573e8-c309-4a34-b731-539001651a14 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:51.667320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592573e8-c309-4a34-b731-539001651a14 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:51.667320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592573e8-c309-4a34-b731-539001651a14 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:51.669894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 744/1486] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 16 14:35:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:35:51.675814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cdeaa-fc71-4feb-8ae1-77e0803828ef None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:51.676366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cdeaa-fc71-4feb-8ae1-77e0803828ef None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:51.676366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cdeaa-fc71-4feb-8ae1-77e0803828ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:51.711213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-271cdeaa-fc71-4feb-8ae1-77e0803828ef None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:51.714928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-271cdeaa-fc71-4feb-8ae1-77e0803828ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:51.725813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 743/1487] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 16 14:35:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:51.886741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592573e8-c309-4a34-b731-539001651a14 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:51.906614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592573e8-c309-4a34-b731-539001651a14 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:51.914321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48339285-e8ca-4c3f-8528-2c690839064e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:51.915876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48339285-e8ca-4c3f-8528-2c690839064e service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:51.916180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48339285-e8ca-4c3f-8528-2c690839064e service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:51.916458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48339285-e8ca-4c3f-8528-2c690839064e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:51.927089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48339285-e8ca-4c3f-8528-2c690839064e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:35:51.955837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48339285-e8ca-4c3f-8528-2c690839064e service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:51.966774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 745/1488] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:35:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:35:55.993439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b318-f788-4866-875c-3e79503b2017 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:55.994444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b318-f788-4866-875c-3e79503b2017 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:55.994444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b318-f788-4866-875c-3e79503b2017 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:55.996895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 744/1489] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:35:55 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:35:56.002534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077fe2-1679-45e6-afe2-ae5d6e50f8eb None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:56.002968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077fe2-1679-45e6-afe2-ae5d6e50f8eb None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:56.003060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077fe2-1679-45e6-afe2-ae5d6e50f8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:56.027224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-45077fe2-1679-45e6-afe2-ae5d6e50f8eb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:56.028361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-45077fe2-1679-45e6-afe2-ae5d6e50f8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:56.035736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 746/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:35:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:56.074269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3b318-f788-4866-875c-3e79503b2017 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:56.076374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f4a3b318-f788-4866-875c-3e79503b2017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:56.150208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3b318-f788-4866-875c-3e79503b2017 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:56.154446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ba530-f303-4e6a-b4c4-10dd4aceef91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:56.154719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba530-f303-4e6a-b4c4-10dd4aceef91 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:56.154990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba530-f303-4e6a-b4c4-10dd4aceef91 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:56.155267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba530-f303-4e6a-b4c4-10dd4aceef91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:56.166871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ba530-f303-4e6a-b4c4-10dd4aceef91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:35:56.191824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ba530-f303-4e6a-b4c4-10dd4aceef91 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:56.201779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 745/1491] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:35:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:35:58.256554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef6b3d-a788-443e-9aa0-51311dbf8443 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:58.257166 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef6b3d-a788-443e-9aa0-51311dbf8443 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:58.257284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef6b3d-a788-443e-9aa0-51311dbf8443 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:58.259504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 747/1492] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:35:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:35:58.265137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77affdfc-e7b0-46e2-bca5-f9ab2c5b54f6 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:58.265576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77affdfc-e7b0-46e2-bca5-f9ab2c5b54f6 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:58.265687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77affdfc-e7b0-46e2-bca5-f9ab2c5b54f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:58.290253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-77affdfc-e7b0-46e2-bca5-f9ab2c5b54f6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:35:58.291386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-77affdfc-e7b0-46e2-bca5-f9ab2c5b54f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:58.299791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 746/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:35:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:35:58.341530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef6b3d-a788-443e-9aa0-51311dbf8443 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:35:58.344360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-21ef6b3d-a788-443e-9aa0-51311dbf8443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:35:58.359711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef6b3d-a788-443e-9aa0-51311dbf8443 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:35:58.363187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69776675-bb1c-4abf-87b4-54b9a1217574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:35:58.363755 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69776675-bb1c-4abf-87b4-54b9a1217574 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:35:58.364040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69776675-bb1c-4abf-87b4-54b9a1217574 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:35:58.364318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69776675-bb1c-4abf-87b4-54b9a1217574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:35:58.374229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69776675-bb1c-4abf-87b4-54b9a1217574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:35:58.400456 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69776675-bb1c-4abf-87b4-54b9a1217574 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:35:58.411250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 748/1494] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:35:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:36:02.125057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff95433-e190-4223-b5b6-f4faa7ea375f None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:36:02.125678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff95433-e190-4223-b5b6-f4faa7ea375f None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:36:02.125678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff95433-e190-4223-b5b6-f4faa7ea375f None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:36:02.127337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 747/1495] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:36:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:36:02.132942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8b3f-7656-41d9-b3de-54c65dd66001 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:36:02.133513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8b3f-7656-41d9-b3de-54c65dd66001 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:36:02.133513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8b3f-7656-41d9-b3de-54c65dd66001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:36:02.158635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-ce1c8b3f-7656-41d9-b3de-54c65dd66001 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:36:02.160065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ce1c8b3f-7656-41d9-b3de-54c65dd66001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:36:02.169853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 749/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:36:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:36:02.228380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff95433-e190-4223-b5b6-f4faa7ea375f None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:36:02.235548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-aff95433-e190-4223-b5b6-f4faa7ea375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:36:02.315063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff95433-e190-4223-b5b6-f4faa7ea375f None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:36:02.320440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a0cfe-336e-476d-b3da-34e25614e8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:36:02.321448 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a0cfe-336e-476d-b3da-34e25614e8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:36:02.321758 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a0cfe-336e-476d-b3da-34e25614e8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:36:02.322041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a0cfe-336e-476d-b3da-34e25614e8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:36:02.333624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a0cfe-336e-476d-b3da-34e25614e8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:36:02.360900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a0cfe-336e-476d-b3da-34e25614e8d5 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:36:02.372182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 748/1497] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:36:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:36:04.386494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d0131-13eb-4c57-964f-b42ad940429d None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:36:04.387039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d0131-13eb-4c57-964f-b42ad940429d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:36:04.387039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d0131-13eb-4c57-964f-b42ad940429d None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:36:04.388764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 750/1498] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 16 14:36:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:36:04.394346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aa043-f007-4ceb-b796-a295805cd20a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:36:04.394868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aa043-f007-4ceb-b796-a295805cd20a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:36:04.394983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aa043-f007-4ceb-b796-a295805cd20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:36:04.420098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-ef9aa043-f007-4ceb-b796-a295805cd20a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:36:04.421193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ef9aa043-f007-4ceb-b796-a295805cd20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:36:04.429525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 749/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 16 14:36:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:36:04.492768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde978d-8424-415b-b348-5d7e8fa812a9 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:36:04.493240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde978d-8424-415b-b348-5d7e8fa812a9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:36:04.493635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde978d-8424-415b-b348-5d7e8fa812a9 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:36:04.495581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 751/1500] 10.222.0.67 () {54 vars in 961 bytes} [Thu Dec 16 14:36:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:36:04.500762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94369-a675-4536-908f-1302755ca6bd None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:36:04.501028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94369-a675-4536-908f-1302755ca6bd None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:36:04.501334 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94369-a675-4536-908f-1302755ca6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:36:04.527175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-a1d94369-a675-4536-908f-1302755ca6bd None None] MFA Rules not processed for user `bb089e686c2540bfadf60b8ea010e441`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:36:04.528357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a1d94369-a675-4536-908f-1302755ca6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:36:04.534736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 750/1501] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Dec 16 14:36:04 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:36:04.542839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde978d-8424-415b-b348-5d7e8fa812a9 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:36:04.555956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde978d-8424-415b-b348-5d7e8fa812a9 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:36:04.560214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bf638-41c3-4162-85e7-f03054c49541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:36:04.560799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf638-41c3-4162-85e7-f03054c49541 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:36:04.561083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf638-41c3-4162-85e7-f03054c49541 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:36:04.561359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf638-41c3-4162-85e7-f03054c49541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:36:04.572459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bf638-41c3-4162-85e7-f03054c49541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:36:04.598587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bf638-41c3-4162-85e7-f03054c49541 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:36:04.610152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 752/1502] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:36:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:36.854101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393155b4-80cf-4c58-bc5d-1b8cff635d59 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:36.855143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393155b4-80cf-4c58-bc5d-1b8cff635d59 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:36.855619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393155b4-80cf-4c58-bc5d-1b8cff635d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:36.886851 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-393155b4-80cf-4c58-bc5d-1b8cff635d59 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:36.888015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-393155b4-80cf-4c58-bc5d-1b8cff635d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:36.899986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 751/1503] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:36.908835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046b7b-f4bc-497e-8e87-08bbbb8f285f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:36.909950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046b7b-f4bc-497e-8e87-08bbbb8f285f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:36.910485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc046b7b-f4bc-497e-8e87-08bbbb8f285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:36.947171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-dc046b7b-f4bc-497e-8e87-08bbbb8f285f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:36.948714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-dc046b7b-f4bc-497e-8e87-08bbbb8f285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:36.963704 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 753/1504] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:36.969216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393155b4-80cf-4c58-bc5d-1b8cff635d59 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:36.984389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393155b4-80cf-4c58-bc5d-1b8cff635d59 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:36.995625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef552d-0803-44d1-bbbe-3d88e25e5813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:36.996253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef552d-0803-44d1-bbbe-3d88e25e5813 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:36.996540 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef552d-0803-44d1-bbbe-3d88e25e5813 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:36.996824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef552d-0803-44d1-bbbe-3d88e25e5813 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:36.997620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef552d-0803-44d1-bbbe-3d88e25e5813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:37:36.997938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef552d-0803-44d1-bbbe-3d88e25e5813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.048430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef552d-0803-44d1-bbbe-3d88e25e5813 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.074715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 752/1505] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:37:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:37.084192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc046b7b-f4bc-497e-8e87-08bbbb8f285f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.093689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d72b2a-f317-4daa-9d18-5af01b0347c9 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.097716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d72b2a-f317-4daa-9d18-5af01b0347c9 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.098619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d72b2a-f317-4daa-9d18-5af01b0347c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.129149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc046b7b-f4bc-497e-8e87-08bbbb8f285f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.151014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cee235-4e75-4d59-9fec-b20f9d6c3e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.152175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee235-4e75-4d59-9fec-b20f9d6c3e66 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.152673 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee235-4e75-4d59-9fec-b20f9d6c3e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.153188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee235-4e75-4d59-9fec-b20f9d6c3e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.154081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cee235-4e75-4d59-9fec-b20f9d6c3e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.184178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e8d72b2a-f317-4daa-9d18-5af01b0347c9 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.185742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e8d72b2a-f317-4daa-9d18-5af01b0347c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.202883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 753/1506] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.204565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbab0c-1f6a-4110-b2be-25eb8328b0c7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.205069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbab0c-1f6a-4110-b2be-25eb8328b0c7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.205569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbab0c-1f6a-4110-b2be-25eb8328b0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.219500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cee235-4e75-4d59-9fec-b20f9d6c3e66 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.283930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-99bbab0c-1f6a-4110-b2be-25eb8328b0c7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.286584 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-99bbab0c-1f6a-4110-b2be-25eb8328b0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.311512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 754/1507] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.313302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bfc2a-a495-43eb-8518-b88fc668bb0c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.316253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 754/1508] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/projects => generated 371 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:37.317827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6e583-d3da-49ff-abf7-13b8d7185b4b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.318437 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bfc2a-a495-43eb-8518-b88fc668bb0c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.319172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bfc2a-a495-43eb-8518-b88fc668bb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.321293 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6e583-d3da-49ff-abf7-13b8d7185b4b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.321812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6e583-d3da-49ff-abf7-13b8d7185b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.369818 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-99e6e583-d3da-49ff-abf7-13b8d7185b4b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.371258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-371bfc2a-a495-43eb-8518-b88fc668bb0c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.374103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-99e6e583-d3da-49ff-abf7-13b8d7185b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.374592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-371bfc2a-a495-43eb-8518-b88fc668bb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.466308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 755/1509] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.466868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 755/1510] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.467032 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bfc2a-a495-43eb-8518-b88fc668bb0c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.468091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dca283-17c2-4a7b-a3b2-4010acf81a8e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.468775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dca283-17c2-4a7b-a3b2-4010acf81a8e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.469063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dca283-17c2-4a7b-a3b2-4010acf81a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.478877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bfc2a-a495-43eb-8518-b88fc668bb0c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.482183 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3264f-8270-4075-80b7-783157b86f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.482969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3264f-8270-4075-80b7-783157b86f02 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.483251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3264f-8270-4075-80b7-783157b86f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.483530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3264f-8270-4075-80b7-783157b86f02 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.484159 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3264f-8270-4075-80b7-783157b86f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.492284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-e2dca283-17c2-4a7b-a3b2-4010acf81a8e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.493483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e2dca283-17c2-4a7b-a3b2-4010acf81a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.500747 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 756/1511] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.503666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b08ea-829f-41a1-a629-69f45de45110 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.506270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b08ea-829f-41a1-a629-69f45de45110 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.507806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b08ea-829f-41a1-a629-69f45de45110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.511847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3264f-8270-4075-80b7-783157b86f02 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.539025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a65b08ea-829f-41a1-a629-69f45de45110 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.539025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a65b08ea-829f-41a1-a629-69f45de45110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.539334 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 756/1512] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/users => generated 286 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:37.539896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4c27f-5c0a-4794-a45b-a1521c1db600 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.540192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4c27f-5c0a-4794-a45b-a1521c1db600 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.540515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4c27f-5c0a-4794-a45b-a1521c1db600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.546214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 757/1513] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.547700 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92358-9e85-4a9b-8b1d-d3c326e48bcc None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.548177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92358-9e85-4a9b-8b1d-d3c326e48bcc None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.548636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92358-9e85-4a9b-8b1d-d3c326e48bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.565614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d3c4c27f-5c0a-4794-a45b-a1521c1db600 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.567927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d3c4c27f-5c0a-4794-a45b-a1521c1db600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.574805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 757/1514] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.575933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4c27f-5c0a-4794-a45b-a1521c1db600 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.576789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b6c92358-9e85-4a9b-8b1d-d3c326e48bcc None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.577941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b6c92358-9e85-4a9b-8b1d-d3c326e48bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.586242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4c27f-5c0a-4794-a45b-a1521c1db600 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.592638 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 758/1515] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.593735 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941afb14-5e88-4d2f-91c1-96f8b178d1c6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.594037 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941afb14-5e88-4d2f-91c1-96f8b178d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.594316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941afb14-5e88-4d2f-91c1-96f8b178d1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.595971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998acd45-5014-424a-b63f-c6d8befc536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.597052 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998acd45-5014-424a-b63f-c6d8befc536e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.597888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998acd45-5014-424a-b63f-c6d8befc536e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.598892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998acd45-5014-424a-b63f-c6d8befc536e admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.600277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998acd45-5014-424a-b63f-c6d8befc536e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:37:37.600801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998acd45-5014-424a-b63f-c6d8befc536e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.617162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-941afb14-5e88-4d2f-91c1-96f8b178d1c6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.618365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-941afb14-5e88-4d2f-91c1-96f8b178d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.625622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 759/1516] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.626454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941afb14-5e88-4d2f-91c1-96f8b178d1c6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.633358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998acd45-5014-424a-b63f-c6d8befc536e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.639166 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941afb14-5e88-4d2f-91c1-96f8b178d1c6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.643649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16d7d7-a9ed-4da3-9dde-4f49227194ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.644418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16d7d7-a9ed-4da3-9dde-4f49227194ea admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.644809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16d7d7-a9ed-4da3-9dde-4f49227194ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.645194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16d7d7-a9ed-4da3-9dde-4f49227194ea admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.646350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16d7d7-a9ed-4da3-9dde-4f49227194ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:37:37.646799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16d7d7-a9ed-4da3-9dde-4f49227194ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.649338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 758/1517] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:37:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:37.650975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998acd45-5014-424a-b63f-c6d8befc536e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.662039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998acd45-5014-424a-b63f-c6d8befc536e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.666560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cac6c-a2ed-479a-b3b2-0fc417655706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.667189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cac6c-a2ed-479a-b3b2-0fc417655706 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.667478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cac6c-a2ed-479a-b3b2-0fc417655706 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.667775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cac6c-a2ed-479a-b3b2-0fc417655706 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.668475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cac6c-a2ed-479a-b3b2-0fc417655706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.672487 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16d7d7-a9ed-4da3-9dde-4f49227194ea admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.685950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 760/1518] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:37:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:37.688023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8abf7a-30e8-49fe-a683-962a83d3e632 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.688316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8abf7a-30e8-49fe-a683-962a83d3e632 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.688597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8abf7a-30e8-49fe-a683-962a83d3e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.695602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cac6c-a2ed-479a-b3b2-0fc417655706 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.706576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 759/1519] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:37 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:37.708408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53386a-e8a5-44e7-9f5f-09ccbeb9bfdb None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.708700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53386a-e8a5-44e7-9f5f-09ccbeb9bfdb None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.708983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53386a-e8a5-44e7-9f5f-09ccbeb9bfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.712093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-ea8abf7a-30e8-49fe-a683-962a83d3e632 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.714324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ea8abf7a-30e8-49fe-a683-962a83d3e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.723718 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 761/1520] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.724902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1390a-7127-476c-9e05-66ffa264ec28 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.725190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1390a-7127-476c-9e05-66ffa264ec28 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.725465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1390a-7127-476c-9e05-66ffa264ec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.733522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3f53386a-e8a5-44e7-9f5f-09ccbeb9bfdb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.734771 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3f53386a-e8a5-44e7-9f5f-09ccbeb9bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.742499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 760/1521] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.743456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53386a-e8a5-44e7-9f5f-09ccbeb9bfdb None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.751055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-4ac1390a-7127-476c-9e05-66ffa264ec28 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.752193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4ac1390a-7127-476c-9e05-66ffa264ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.752950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53386a-e8a5-44e7-9f5f-09ccbeb9bfdb None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.757683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05678f-042a-4a31-ab6b-247fa2056968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.758330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05678f-042a-4a31-ab6b-247fa2056968 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.758612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05678f-042a-4a31-ab6b-247fa2056968 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.758887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05678f-042a-4a31-ab6b-247fa2056968 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.759574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05678f-042a-4a31-ab6b-247fa2056968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:37:37.759867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05678f-042a-4a31-ab6b-247fa2056968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.763589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 762/1522] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.763589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b3776-b4f3-41db-8e78-8b1f6f3f573f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.763589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b3776-b4f3-41db-8e78-8b1f6f3f573f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.763589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b3776-b4f3-41db-8e78-8b1f6f3f573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.785271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05678f-042a-4a31-ab6b-247fa2056968 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.785630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6a8b3776-b4f3-41db-8e78-8b1f6f3f573f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:37.786917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6a8b3776-b4f3-41db-8e78-8b1f6f3f573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:37.794730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 763/1523] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:37.795864 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b3776-b4f3-41db-8e78-8b1f6f3f573f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.802578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 761/1524] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:37:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:37.803529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05678f-042a-4a31-ab6b-247fa2056968 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.805751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b3776-b4f3-41db-8e78-8b1f6f3f573f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.810562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7998-a067-4d6c-b563-147e84069381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.811276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7998-a067-4d6c-b563-147e84069381 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.811658 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7998-a067-4d6c-b563-147e84069381 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.811998 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7998-a067-4d6c-b563-147e84069381 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.812651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7998-a067-4d6c-b563-147e84069381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.813544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05678f-042a-4a31-ab6b-247fa2056968 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.818380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b2f9a-7dc2-4e85-97b1-689df0264410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.818983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b2f9a-7dc2-4e85-97b1-689df0264410 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.819265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b2f9a-7dc2-4e85-97b1-689df0264410 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.819539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b2f9a-7dc2-4e85-97b1-689df0264410 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.820197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b2f9a-7dc2-4e85-97b1-689df0264410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.839274 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7998-a067-4d6c-b563-147e84069381 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.846592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b2f9a-7dc2-4e85-97b1-689df0264410 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.870784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 764/1525] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:37.874956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7998-a067-4d6c-b563-147e84069381 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.877113 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 762/1526] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:37 2021] POST /identity/v3/projects => generated 401 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:37.877787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b2f9a-7dc2-4e85-97b1-689df0264410 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:37.947767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b2f9a-7dc2-4e85-97b1-689df0264410 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.949838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7998-a067-4d6c-b563-147e84069381 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:37.952252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1f415-cf0b-4bf8-96d2-164c78ff1a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.953043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1f415-cf0b-4bf8-96d2-164c78ff1a26 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.953327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1f415-cf0b-4bf8-96d2-164c78ff1a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.953700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1f415-cf0b-4bf8-96d2-164c78ff1a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.954702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1f415-cf0b-4bf8-96d2-164c78ff1a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:37:37.955001 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1f415-cf0b-4bf8-96d2-164c78ff1a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.955396 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab65a-5798-408f-8cbb-bc78c40606fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:37.956307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab65a-5798-408f-8cbb-bc78c40606fc admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:37.956589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab65a-5798-408f-8cbb-bc78c40606fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:37.956952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab65a-5798-408f-8cbb-bc78c40606fc admin admin] PATH_INFO: `/v3/projects/568bf2d67c774d5cbd81d2cbbfa4e1cc/users/7fd015c070a543d688b06d5c2650d486/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:37.981122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ab65a-5798-408f-8cbb-bc78c40606fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=568bf2d67c774d5cbd81d2cbbfa4e1cc, user_id=7fd015c070a543d688b06d5c2650d486, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:37.981850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1f415-cf0b-4bf8-96d2-164c78ff1a26 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:37.995727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 763/1527] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:37:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:37.996582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1f415-cf0b-4bf8-96d2-164c78ff1a26 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.006643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1f415-cf0b-4bf8-96d2-164c78ff1a26 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.008092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ab65a-5798-408f-8cbb-bc78c40606fc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.011090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64945-e9dd-40a2-9424-fd87ce3901b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.011695 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64945-e9dd-40a2-9424-fd87ce3901b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.011965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64945-e9dd-40a2-9424-fd87ce3901b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.012260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64945-e9dd-40a2-9424-fd87ce3901b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.012948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64945-e9dd-40a2-9424-fd87ce3901b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:37:38.013294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64945-e9dd-40a2-9424-fd87ce3901b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.023810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 765/1528] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:37 2021] PUT /identity/v3/projects/568bf2d67c774d5cbd81d2cbbfa4e1cc/users/7fd015c070a543d688b06d5c2650d486/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:38.024701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab65a-5798-408f-8cbb-bc78c40606fc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.040510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64945-e9dd-40a2-9424-fd87ce3901b6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.054988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 764/1529] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:37:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:38.056378 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83545cb1-d974-4e34-a1ce-c81f7f2e83af None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.056671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83545cb1-d974-4e34-a1ce-c81f7f2e83af None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.056954 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83545cb1-d974-4e34-a1ce-c81f7f2e83af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.085174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-83545cb1-d974-4e34-a1ce-c81f7f2e83af None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:38.086768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-83545cb1-d974-4e34-a1ce-c81f7f2e83af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:38.098783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab65a-5798-408f-8cbb-bc78c40606fc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.103139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaf4f1-a43a-4fe1-ab65-5b9d9238c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.103795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaf4f1-a43a-4fe1-ab65-5b9d9238c3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.104031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaf4f1-a43a-4fe1-ab65-5b9d9238c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.104312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaf4f1-a43a-4fe1-ab65-5b9d9238c3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.105018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaf4f1-a43a-4fe1-ab65-5b9d9238c3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:37:38.105315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaf4f1-a43a-4fe1-ab65-5b9d9238c3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.131067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaf4f1-a43a-4fe1-ab65-5b9d9238c3d2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.144383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 766/1530] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:37:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:38.145225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaf4f1-a43a-4fe1-ab65-5b9d9238c3d2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.155906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 765/1531] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:38.156649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaf4f1-a43a-4fe1-ab65-5b9d9238c3d2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.160877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83545cb1-d974-4e34-a1ce-c81f7f2e83af None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.161873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e665cd-9fd6-4cf7-adc6-32b0b2f02a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.162505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e665cd-9fd6-4cf7-adc6-32b0b2f02a9a admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.162795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e665cd-9fd6-4cf7-adc6-32b0b2f02a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.163073 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e665cd-9fd6-4cf7-adc6-32b0b2f02a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.163784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e665cd-9fd6-4cf7-adc6-32b0b2f02a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.171277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83545cb1-d974-4e34-a1ce-c81f7f2e83af None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.175617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a00dbc-c93a-4360-a37a-2bc7c6679adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.176260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a00dbc-c93a-4360-a37a-2bc7c6679adb admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.176546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a00dbc-c93a-4360-a37a-2bc7c6679adb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.176826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a00dbc-c93a-4360-a37a-2bc7c6679adb admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.177464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a00dbc-c93a-4360-a37a-2bc7c6679adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.189947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e665cd-9fd6-4cf7-adc6-32b0b2f02a9a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.203525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a00dbc-c93a-4360-a37a-2bc7c6679adb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.221401 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 767/1532] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.222241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e665cd-9fd6-4cf7-adc6-32b0b2f02a9a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.225680 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 766/1533] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/users => generated 293 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.226515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a00dbc-c93a-4360-a37a-2bc7c6679adb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.235793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a00dbc-c93a-4360-a37a-2bc7c6679adb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.294387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e665cd-9fd6-4cf7-adc6-32b0b2f02a9a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.298861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e54cca-9dcf-4e06-9f35-d40af0a7c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.299494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e54cca-9dcf-4e06-9f35-d40af0a7c966 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.299775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e54cca-9dcf-4e06-9f35-d40af0a7c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.300055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e54cca-9dcf-4e06-9f35-d40af0a7c966 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.300788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e54cca-9dcf-4e06-9f35-d40af0a7c966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.307164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a497e2-3bad-44cd-88c5-290f027bfb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.307896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a497e2-3bad-44cd-88c5-290f027bfb72 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.308191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a497e2-3bad-44cd-88c5-290f027bfb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.308491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a497e2-3bad-44cd-88c5-290f027bfb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.309223 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a497e2-3bad-44cd-88c5-290f027bfb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.326900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e54cca-9dcf-4e06-9f35-d40af0a7c966 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.335586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a497e2-3bad-44cd-88c5-290f027bfb72 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.352821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 768/1534] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/users => generated 301 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.352821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742185-93db-41b0-8ce3-e7c79eed7a23 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.352821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742185-93db-41b0-8ce3-e7c79eed7a23 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.352821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742185-93db-41b0-8ce3-e7c79eed7a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.365627 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 767/1535] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.366970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a497e2-3bad-44cd-88c5-290f027bfb72 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.391926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0d742185-93db-41b0-8ce3-e7c79eed7a23 None None] MFA Rules not processed for user `7fd015c070a543d688b06d5c2650d486`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:38.393097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0d742185-93db-41b0-8ce3-e7c79eed7a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:38.446396 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a497e2-3bad-44cd-88c5-290f027bfb72 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.450795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420a0c0-f5e7-4d0b-a492-85b12cf6e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.451439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a0c0-f5e7-4d0b-a492-85b12cf6e6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.451726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a0c0-f5e7-4d0b-a492-85b12cf6e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.452144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a0c0-f5e7-4d0b-a492-85b12cf6e6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.452650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420a0c0-f5e7-4d0b-a492-85b12cf6e6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.475746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 769/1536] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:38.480227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d742185-93db-41b0-8ce3-e7c79eed7a23 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.480393 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420a0c0-f5e7-4d0b-a492-85b12cf6e6b2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.487833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d742185-93db-41b0-8ce3-e7c79eed7a23 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.492219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa912c8-a9dc-483d-8cac-503f2705682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.492812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa912c8-a9dc-483d-8cac-503f2705682a admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.493090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa912c8-a9dc-483d-8cac-503f2705682a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.493368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa912c8-a9dc-483d-8cac-503f2705682a admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.494022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa912c8-a9dc-483d-8cac-503f2705682a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.512348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 768/1537] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/projects => generated 357 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.512348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420a0c0-f5e7-4d0b-a492-85b12cf6e6b2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.521499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa912c8-a9dc-483d-8cac-503f2705682a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.553287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 770/1538] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.554384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa912c8-a9dc-483d-8cac-503f2705682a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.592952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420a0c0-f5e7-4d0b-a492-85b12cf6e6b2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.630996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa912c8-a9dc-483d-8cac-503f2705682a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.635495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d13b8-a151-402b-8b2b-210c49ac8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.636235 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d13b8-a151-402b-8b2b-210c49ac8952 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.636522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d13b8-a151-402b-8b2b-210c49ac8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.636796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d13b8-a151-402b-8b2b-210c49ac8952 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.637428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d13b8-a151-402b-8b2b-210c49ac8952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.658098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00793f5c-2515-46d9-a3b0-65ec8041156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.658703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00793f5c-2515-46d9-a3b0-65ec8041156f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.658990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00793f5c-2515-46d9-a3b0-65ec8041156f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.659263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00793f5c-2515-46d9-a3b0-65ec8041156f admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.660179 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00793f5c-2515-46d9-a3b0-65ec8041156f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:37:38.660587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00793f5c-2515-46d9-a3b0-65ec8041156f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.663306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d13b8-a151-402b-8b2b-210c49ac8952 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.684938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 771/1539] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.685841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d13b8-a151-402b-8b2b-210c49ac8952 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.688681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00793f5c-2515-46d9-a3b0-65ec8041156f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.696328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d13b8-a151-402b-8b2b-210c49ac8952 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.701427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a240cf8-b3df-40e9-9762-f8a0c67e1173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.709543 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 769/1540] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:37:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:38.709746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240cf8-b3df-40e9-9762-f8a0c67e1173 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.709746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240cf8-b3df-40e9-9762-f8a0c67e1173 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.709935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00793f5c-2515-46d9-a3b0-65ec8041156f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.710065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240cf8-b3df-40e9-9762-f8a0c67e1173 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.710065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a240cf8-b3df-40e9-9762-f8a0c67e1173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.712740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00793f5c-2515-46d9-a3b0-65ec8041156f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.717322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026c762-d310-4803-ad1e-d0d01735738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.717940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026c762-d310-4803-ad1e-d0d01735738c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.718338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026c762-d310-4803-ad1e-d0d01735738c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.718619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026c762-d310-4803-ad1e-d0d01735738c admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.719321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026c762-d310-4803-ad1e-d0d01735738c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.730516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a240cf8-b3df-40e9-9762-f8a0c67e1173 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.742666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 772/1541] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:38 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:38.743481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a240cf8-b3df-40e9-9762-f8a0c67e1173 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.745431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026c762-d310-4803-ad1e-d0d01735738c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.753505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a240cf8-b3df-40e9-9762-f8a0c67e1173 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.757450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 770/1542] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:38 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:38.758303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026c762-d310-4803-ad1e-d0d01735738c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.758441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7f00-3b65-4c9d-8494-f52289f5d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.758988 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7f00-3b65-4c9d-8494-f52289f5d23c admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.759277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7f00-3b65-4c9d-8494-f52289f5d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.759561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7f00-3b65-4c9d-8494-f52289f5d23c admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.760183 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c7f00-3b65-4c9d-8494-f52289f5d23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.768193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026c762-d310-4803-ad1e-d0d01735738c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.773199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93f1a6-7078-49ec-947d-881c3d151c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.773790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93f1a6-7078-49ec-947d-881c3d151c75 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.774111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93f1a6-7078-49ec-947d-881c3d151c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.774399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93f1a6-7078-49ec-947d-881c3d151c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.775060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93f1a6-7078-49ec-947d-881c3d151c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.788082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c7f00-3b65-4c9d-8494-f52289f5d23c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.801324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93f1a6-7078-49ec-947d-881c3d151c75 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.812645 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 773/1543] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/users => generated 288 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.812645 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7f00-3b65-4c9d-8494-f52289f5d23c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.823609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7f00-3b65-4c9d-8494-f52289f5d23c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.828551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b7355-0c0a-4a78-b12a-2bfb7b90a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.829135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b7355-0c0a-4a78-b12a-2bfb7b90a21f admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.829419 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b7355-0c0a-4a78-b12a-2bfb7b90a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.829703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b7355-0c0a-4a78-b12a-2bfb7b90a21f admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.830450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b7355-0c0a-4a78-b12a-2bfb7b90a21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.833586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 771/1544] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.834619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93f1a6-7078-49ec-947d-881c3d151c75 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.857845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b7355-0c0a-4a78-b12a-2bfb7b90a21f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.880464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 774/1545] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/users => generated 279 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.881250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b7355-0c0a-4a78-b12a-2bfb7b90a21f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.890580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b7355-0c0a-4a78-b12a-2bfb7b90a21f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.913813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93f1a6-7078-49ec-947d-881c3d151c75 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.918520 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b6448-0586-408b-a49c-358f367b8ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.919176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b6448-0586-408b-a49c-358f367b8ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.919460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b6448-0586-408b-a49c-358f367b8ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.919738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b6448-0586-408b-a49c-358f367b8ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.920421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b6448-0586-408b-a49c-358f367b8ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.947034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b6448-0586-408b-a49c-358f367b8ef4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.955184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb169f-2cb2-439f-b01d-6f0371696354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.956458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb169f-2cb2-439f-b01d-6f0371696354 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.956748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb169f-2cb2-439f-b01d-6f0371696354 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.957207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb169f-2cb2-439f-b01d-6f0371696354 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.958017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb169f-2cb2-439f-b01d-6f0371696354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.977590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 772/1546] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:38.977590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b6448-0586-408b-a49c-358f367b8ef4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:38.984220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b6448-0586-408b-a49c-358f367b8ef4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:38.984994 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb169f-2cb2-439f-b01d-6f0371696354 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:38.988806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06b3d-6db9-451d-9842-b55066d01fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:38.989407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06b3d-6db9-451d-9842-b55066d01fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:38.989693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06b3d-6db9-451d-9842-b55066d01fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:38.989982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06b3d-6db9-451d-9842-b55066d01fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:38.990658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d06b3d-6db9-451d-9842-b55066d01fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:38.996191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 775/1547] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:38 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:38.997015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb169f-2cb2-439f-b01d-6f0371696354 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.008611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb169f-2cb2-439f-b01d-6f0371696354 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.013091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5696c1-90fc-423c-b6e8-65b1ab0ca23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.013925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5696c1-90fc-423c-b6e8-65b1ab0ca23d admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.014245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5696c1-90fc-423c-b6e8-65b1ab0ca23d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.014566 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5696c1-90fc-423c-b6e8-65b1ab0ca23d admin admin] PATH_INFO: `/v3/projects/01711b77f7c44e5ea58e99d5d3579417/users/49cacc1c6e6d4593833f57ee62ac8cf6/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.016867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d06b3d-6db9-451d-9842-b55066d01fe3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.038759 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5696c1-90fc-423c-b6e8-65b1ab0ca23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01711b77f7c44e5ea58e99d5d3579417, user_id=49cacc1c6e6d4593833f57ee62ac8cf6, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.051612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 773/1548] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:38 2021] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:39.052513 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06b3d-6db9-451d-9842-b55066d01fe3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.076501 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5696c1-90fc-423c-b6e8-65b1ab0ca23d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.099797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 776/1549] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:38 2021] PUT /identity/v3/projects/01711b77f7c44e5ea58e99d5d3579417/users/49cacc1c6e6d4593833f57ee62ac8cf6/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:39.109737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5696c1-90fc-423c-b6e8-65b1ab0ca23d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.137442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06b3d-6db9-451d-9842-b55066d01fe3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.197926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5696c1-90fc-423c-b6e8-65b1ab0ca23d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.202737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9df7d-747a-489c-91da-ccc094823361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.203346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9df7d-747a-489c-91da-ccc094823361 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.203639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9df7d-747a-489c-91da-ccc094823361 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.203905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9df7d-747a-489c-91da-ccc094823361 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.204609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9df7d-747a-489c-91da-ccc094823361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.205675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e41f-5334-4bd5-8233-7e2a7e533157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.206578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e41f-5334-4bd5-8233-7e2a7e533157 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.206894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e41f-5334-4bd5-8233-7e2a7e533157 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.207199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e41f-5334-4bd5-8233-7e2a7e533157 admin admin] PATH_INFO: `/v3/projects/0212998f80a74b93ab8101caf0416034/users/f0d8e37ea7764ab0ab75e82b2dbd9f9c/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.227719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259e41f-5334-4bd5-8233-7e2a7e533157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0212998f80a74b93ab8101caf0416034, user_id=f0d8e37ea7764ab0ab75e82b2dbd9f9c, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.230512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9df7d-747a-489c-91da-ccc094823361 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.241893 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 777/1550] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:39 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:39.245542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9df7d-747a-489c-91da-ccc094823361 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.255120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259e41f-5334-4bd5-8233-7e2a7e533157 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.255364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9df7d-747a-489c-91da-ccc094823361 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.260227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c09503-d551-49bf-9ded-94d1e5afefd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.260984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c09503-d551-49bf-9ded-94d1e5afefd6 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.261370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c09503-d551-49bf-9ded-94d1e5afefd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.261580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c09503-d551-49bf-9ded-94d1e5afefd6 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.262486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c09503-d551-49bf-9ded-94d1e5afefd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.270834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 774/1551] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:39 2021] PUT /identity/v3/projects/0212998f80a74b93ab8101caf0416034/users/f0d8e37ea7764ab0ab75e82b2dbd9f9c/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:39.271695 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e41f-5334-4bd5-8233-7e2a7e533157 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.288966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c09503-d551-49bf-9ded-94d1e5afefd6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.309743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 778/1552] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:39 2021] POST /identity/v3/users => generated 293 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:39.311759 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c09503-d551-49bf-9ded-94d1e5afefd6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.324060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c09503-d551-49bf-9ded-94d1e5afefd6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.356418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e41f-5334-4bd5-8233-7e2a7e533157 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.361427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72505c-043d-483e-a6a7-998c9b313568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.362084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72505c-043d-483e-a6a7-998c9b313568 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.362363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72505c-043d-483e-a6a7-998c9b313568 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.362625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72505c-043d-483e-a6a7-998c9b313568 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.364779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72505c-043d-483e-a6a7-998c9b313568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.393811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2dbbb-adf4-453c-b32d-57e46c7727e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.394573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2dbbb-adf4-453c-b32d-57e46c7727e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.394842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2dbbb-adf4-453c-b32d-57e46c7727e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.395121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2dbbb-adf4-453c-b32d-57e46c7727e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.395886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2dbbb-adf4-453c-b32d-57e46c7727e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.399936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72505c-043d-483e-a6a7-998c9b313568 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.411283 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 775/1553] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:39 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:39.412278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72505c-043d-483e-a6a7-998c9b313568 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.421889 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2dbbb-adf4-453c-b32d-57e46c7727e3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.422715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72505c-043d-483e-a6a7-998c9b313568 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.427805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e6f2e-f095-4308-b2d5-549a234161c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.428646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e6f2e-f095-4308-b2d5-549a234161c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.428922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e6f2e-f095-4308-b2d5-549a234161c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.429199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e6f2e-f095-4308-b2d5-549a234161c2 admin admin] PATH_INFO: `/v3/projects/198be39f56934fc58b1c76e532336733/users/0d72966786b641f48edda655d2d0ba45/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.433469 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 779/1554] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:39 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:39.434474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2dbbb-adf4-453c-b32d-57e46c7727e3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.445003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2dbbb-adf4-453c-b32d-57e46c7727e3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.450414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e5750-156f-4fec-9e8e-6747ea8f8460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.451063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e5750-156f-4fec-9e8e-6747ea8f8460 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.451364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e5750-156f-4fec-9e8e-6747ea8f8460 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.451646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e5750-156f-4fec-9e8e-6747ea8f8460 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.452304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e5750-156f-4fec-9e8e-6747ea8f8460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.452897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e6f2e-f095-4308-b2d5-549a234161c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198be39f56934fc58b1c76e532336733, user_id=0d72966786b641f48edda655d2d0ba45, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.479477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e5750-156f-4fec-9e8e-6747ea8f8460 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.492429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e6f2e-f095-4308-b2d5-549a234161c2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.502532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 780/1555] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:39 2021] POST /identity/v3/users => generated 289 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:39.504025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6e26-0b90-4d18-9ba4-2e734b414879 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.504314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6e26-0b90-4d18-9ba4-2e734b414879 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.504598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6e26-0b90-4d18-9ba4-2e734b414879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.511862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 776/1556] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:39 2021] PUT /identity/v3/projects/198be39f56934fc58b1c76e532336733/users/0d72966786b641f48edda655d2d0ba45/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:39.511862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e6f2e-f095-4308-b2d5-549a234161c2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.545269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b1bf6e26-0b90-4d18-9ba4-2e734b414879 None None] MFA Rules not processed for user `49cacc1c6e6d4593833f57ee62ac8cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:39.546511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b1bf6e26-0b90-4d18-9ba4-2e734b414879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:39.600925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e6f2e-f095-4308-b2d5-549a234161c2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.606993 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc22c8-cefc-44a1-b581-e5da5a14c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.608055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc22c8-cefc-44a1-b581-e5da5a14c291 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.608560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc22c8-cefc-44a1-b581-e5da5a14c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.609042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc22c8-cefc-44a1-b581-e5da5a14c291 admin admin] PATH_INFO: `/v3/projects/216e877cb3c8483eb1ec6a2b665198c8/users/8eefa2f6a3f845c29ab1dcf3d04da383/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.626440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 781/1557] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:39 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:39.627720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8999-21bb-46af-899e-e9711c40ea90 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.628011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8999-21bb-46af-899e-e9711c40ea90 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.628291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8999-21bb-46af-899e-e9711c40ea90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.634011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc22c8-cefc-44a1-b581-e5da5a14c291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216e877cb3c8483eb1ec6a2b665198c8, user_id=8eefa2f6a3f845c29ab1dcf3d04da383, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.662114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc22c8-cefc-44a1-b581-e5da5a14c291 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.665938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d6dd8999-21bb-46af-899e-e9711c40ea90 None None] MFA Rules not processed for user `f0d8e37ea7764ab0ab75e82b2dbd9f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:39.667133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d6dd8999-21bb-46af-899e-e9711c40ea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:39.677447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 777/1558] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:39 2021] PUT /identity/v3/projects/216e877cb3c8483eb1ec6a2b665198c8/users/8eefa2f6a3f845c29ab1dcf3d04da383/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:39.687599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc22c8-cefc-44a1-b581-e5da5a14c291 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.741691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 782/1559] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:39 2021] POST /identity/v3/auth/tokens => generated 3708 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:39.742771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8999-21bb-46af-899e-e9711c40ea90 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.754377 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8999-21bb-46af-899e-e9711c40ea90 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.759280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc165-7895-4419-8f52-d305a835ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.760114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc165-7895-4419-8f52-d305a835ba66 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.760448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc165-7895-4419-8f52-d305a835ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.760674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bc165-7895-4419-8f52-d305a835ba66 admin admin] PATH_INFO: `/v3/projects/be57c1f88c1c41d48335ae667c4a7038/users/d855c6ff5d54404ebcd529a5f0093a97/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.763265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc22c8-cefc-44a1-b581-e5da5a14c291 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.768498 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f2530-56d0-4591-9dda-cc9e18165f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.769216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f2530-56d0-4591-9dda-cc9e18165f5b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.769547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f2530-56d0-4591-9dda-cc9e18165f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.769833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f2530-56d0-4591-9dda-cc9e18165f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.770796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f2530-56d0-4591-9dda-cc9e18165f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.782981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bc165-7895-4419-8f52-d305a835ba66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be57c1f88c1c41d48335ae667c4a7038, user_id=d855c6ff5d54404ebcd529a5f0093a97, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.796958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f2530-56d0-4591-9dda-cc9e18165f5b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.808341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 778/1560] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:39 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:39.809142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f2530-56d0-4591-9dda-cc9e18165f5b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.810034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bc165-7895-4419-8f52-d305a835ba66 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.819053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f2530-56d0-4591-9dda-cc9e18165f5b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.825871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 783/1561] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:39 2021] PUT /identity/v3/projects/be57c1f88c1c41d48335ae667c4a7038/users/d855c6ff5d54404ebcd529a5f0093a97/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:39.826989 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc165-7895-4419-8f52-d305a835ba66 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:39.890482 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3b81-9f4d-415c-a60a-4e7f10e1a512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.891347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3b81-9f4d-415c-a60a-4e7f10e1a512 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.891630 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3b81-9f4d-415c-a60a-4e7f10e1a512 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.891906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3b81-9f4d-415c-a60a-4e7f10e1a512 admin admin] PATH_INFO: `/v3/projects/f78091827c644b1fb185ec17f9aa73e2/users/6c6c792676f1498e98f638a268abf1e5/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.899285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bc165-7895-4419-8f52-d305a835ba66 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:39.904120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c58a8c-a1f1-4bed-91ab-29e0186d68ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:39.905007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c58a8c-a1f1-4bed-91ab-29e0186d68ba admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.905477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c58a8c-a1f1-4bed-91ab-29e0186d68ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.905950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c58a8c-a1f1-4bed-91ab-29e0186d68ba admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.907412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c58a8c-a1f1-4bed-91ab-29e0186d68ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.913752 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b3b81-9f4d-415c-a60a-4e7f10e1a512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78091827c644b1fb185ec17f9aa73e2, user_id=6c6c792676f1498e98f638a268abf1e5, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:39.936200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c58a8c-a1f1-4bed-91ab-29e0186d68ba admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.940711 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b3b81-9f4d-415c-a60a-4e7f10e1a512 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:39.949607 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 784/1562] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:39 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:39.951127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d09b-c634-474a-9d00-4cc44af957ca None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.951516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d09b-c634-474a-9d00-4cc44af957ca None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.951809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d09b-c634-474a-9d00-4cc44af957ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.961621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 779/1563] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:39 2021] PUT /identity/v3/projects/f78091827c644b1fb185ec17f9aa73e2/users/6c6c792676f1498e98f638a268abf1e5/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:39.963325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840d48-c401-4379-b710-9cec6fad26b8 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.964235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840d48-c401-4379-b710-9cec6fad26b8 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.964235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840d48-c401-4379-b710-9cec6fad26b8 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.966028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 780/1564] 10.222.0.67 () {54 vars in 959 bytes} [Thu Dec 16 14:37:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:39.971308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edc29b-af08-4893-a978-807afbd956e8 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:39.971712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edc29b-af08-4893-a978-807afbd956e8 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:39.972003 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edc29b-af08-4893-a978-807afbd956e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:39.979157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-e257d09b-c634-474a-9d00-4cc44af957ca None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:39.980345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e257d09b-c634-474a-9d00-4cc44af957ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:40.016399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-a2edc29b-af08-4893-a978-807afbd956e8 None None] MFA Rules not processed for user `8eefa2f6a3f845c29ab1dcf3d04da383`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:40.017490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a2edc29b-af08-4893-a978-807afbd956e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:40.054372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 785/1565] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:40.055316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257d09b-c634-474a-9d00-4cc44af957ca None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.072166 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257d09b-c634-474a-9d00-4cc44af957ca None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.077029 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453e881-d22d-4d10-bd09-7e54e886a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.077846 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e881-d22d-4d10-bd09-7e54e886a09e admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.078397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e881-d22d-4d10-bd09-7e54e886a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.078887 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e881-d22d-4d10-bd09-7e54e886a09e admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.080222 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453e881-d22d-4d10-bd09-7e54e886a09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:40.099256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 781/1566] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:39 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:40.099256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edc29b-af08-4893-a978-807afbd956e8 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.109225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edc29b-af08-4893-a978-807afbd956e8 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.110362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453e881-d22d-4d10-bd09-7e54e886a09e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:40.114372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcadd0e-543d-4fa8-9af7-e5847da6c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.115210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcadd0e-543d-4fa8-9af7-e5847da6c28a admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.115626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcadd0e-543d-4fa8-9af7-e5847da6c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.115911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcadd0e-543d-4fa8-9af7-e5847da6c28a admin admin] PATH_INFO: `/v3/projects/3b02e727e9284148b9648cc8f69a9070/users/1285bf2b40904d24ad796261f2762906/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.138254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcadd0e-543d-4fa8-9af7-e5847da6c28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b02e727e9284148b9648cc8f69a9070, user_id=1285bf2b40904d24ad796261f2762906, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:40.144352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 786/1567] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:40 2021] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:40.146700 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d45fc-c8f1-458f-8887-7af5123dea1b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.147499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d45fc-c8f1-458f-8887-7af5123dea1b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.148305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d45fc-c8f1-458f-8887-7af5123dea1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.165950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcadd0e-543d-4fa8-9af7-e5847da6c28a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:40.183349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 782/1568] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:40 2021] PUT /identity/v3/projects/3b02e727e9284148b9648cc8f69a9070/users/1285bf2b40904d24ad796261f2762906/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:40.184757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcadd0e-543d-4fa8-9af7-e5847da6c28a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.211192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5f6d45fc-c8f1-458f-8887-7af5123dea1b None None] MFA Rules not processed for user `d855c6ff5d54404ebcd529a5f0093a97`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:40.212788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5f6d45fc-c8f1-458f-8887-7af5123dea1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:40.254942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcadd0e-543d-4fa8-9af7-e5847da6c28a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.259458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde983-2a28-4425-bc19-8a6b1700c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.260322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde983-2a28-4425-bc19-8a6b1700c574 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.260612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde983-2a28-4425-bc19-8a6b1700c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.260888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde983-2a28-4425-bc19-8a6b1700c574 admin admin] PATH_INFO: `/v3/projects/bb69c5ffb21a48ba9f80a543e763d5d4/users/108e1d33249b49dcb6e3779514bc7a9b/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.281826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde983-2a28-4425-bc19-8a6b1700c574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb69c5ffb21a48ba9f80a543e763d5d4, user_id=108e1d33249b49dcb6e3779514bc7a9b, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:40.288900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 787/1569] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:40 2021] POST /identity/v3/auth/tokens => generated 3664 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:40.290081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008095b3-a31d-43e9-8ab5-9a0a85dda85b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.290385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008095b3-a31d-43e9-8ab5-9a0a85dda85b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.290656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008095b3-a31d-43e9-8ab5-9a0a85dda85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.310253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde983-2a28-4425-bc19-8a6b1700c574 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:40.312204 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-008095b3-a31d-43e9-8ab5-9a0a85dda85b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:40.313389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-008095b3-a31d-43e9-8ab5-9a0a85dda85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:40.320639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 788/1570] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:40.322036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95180a9b-17eb-4d23-92cc-721d646ccfe5 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.322329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95180a9b-17eb-4d23-92cc-721d646ccfe5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.322600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95180a9b-17eb-4d23-92cc-721d646ccfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.326873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 783/1571] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:40 2021] PUT /identity/v3/projects/bb69c5ffb21a48ba9f80a543e763d5d4/users/108e1d33249b49dcb6e3779514bc7a9b/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:40.327860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde983-2a28-4425-bc19-8a6b1700c574 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.352800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-95180a9b-17eb-4d23-92cc-721d646ccfe5 None None] MFA Rules not processed for user `f2bcc9f013f14ed89f5e94591f170b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:40.354016 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-95180a9b-17eb-4d23-92cc-721d646ccfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:40.397894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde983-2a28-4425-bc19-8a6b1700c574 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.402043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796eb44-e40d-40dc-a704-60d44111969d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.402773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796eb44-e40d-40dc-a704-60d44111969d service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.403269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796eb44-e40d-40dc-a704-60d44111969d service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.403624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796eb44-e40d-40dc-a704-60d44111969d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.432738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 789/1572] 10.222.0.67 () {58 vars in 1056 bytes} [Thu Dec 16 14:37:40 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:40.433614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95180a9b-17eb-4d23-92cc-721d646ccfe5 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.482776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796eb44-e40d-40dc-a704-60d44111969d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:40.522615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95180a9b-17eb-4d23-92cc-721d646ccfe5 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.529471 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65830-5307-484a-ace7-1e9b1d0fe9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.530476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65830-5307-484a-ace7-1e9b1d0fe9ce admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.530960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65830-5307-484a-ace7-1e9b1d0fe9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.531366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65830-5307-484a-ace7-1e9b1d0fe9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.532908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d65830-5307-484a-ace7-1e9b1d0fe9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:40.533721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796eb44-e40d-40dc-a704-60d44111969d service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:40.550027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 784/1573] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:40.551377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796eb44-e40d-40dc-a704-60d44111969d service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.562923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796eb44-e40d-40dc-a704-60d44111969d service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.569389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fa42-6b2a-4f93-8be6-bd2eca94d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.569969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fa42-6b2a-4f93-8be6-bd2eca94d703 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.570140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d65830-5307-484a-ace7-1e9b1d0fe9ce admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:40.570268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fa42-6b2a-4f93-8be6-bd2eca94d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.570534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fa42-6b2a-4f93-8be6-bd2eca94d703 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.571212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333fa42-6b2a-4f93-8be6-bd2eca94d703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:40.598358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333fa42-6b2a-4f93-8be6-bd2eca94d703 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:40.606024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 790/1574] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:40 2021] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:40.607135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65830-5307-484a-ace7-1e9b1d0fe9ce admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.624009 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 785/1575] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:40 2021] POST /identity/v3/users => generated 309 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:40.625141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fa42-6b2a-4f93-8be6-bd2eca94d703 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.638697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fa42-6b2a-4f93-8be6-bd2eca94d703 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.690593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65830-5307-484a-ace7-1e9b1d0fe9ce admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.695863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62321fd9-511f-453b-9790-edef3ee8c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.696636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62321fd9-511f-453b-9790-edef3ee8c996 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.696876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62321fd9-511f-453b-9790-edef3ee8c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.697283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62321fd9-511f-453b-9790-edef3ee8c996 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.698080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62321fd9-511f-453b-9790-edef3ee8c996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:40.715098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d8579-36f7-4fec-bed2-1d4d05a58437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.715794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d8579-36f7-4fec-bed2-1d4d05a58437 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.716085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d8579-36f7-4fec-bed2-1d4d05a58437 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.716375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d8579-36f7-4fec-bed2-1d4d05a58437 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.717035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d8579-36f7-4fec-bed2-1d4d05a58437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:40.724372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62321fd9-511f-453b-9790-edef3ee8c996 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:40.736287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 791/1576] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:40 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:40.737312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62321fd9-511f-453b-9790-edef3ee8c996 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.746415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d8579-36f7-4fec-bed2-1d4d05a58437 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:40.776894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 786/1577] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:40 2021] POST /identity/v3/projects => generated 357 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:40.778647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357434fc-8f6a-4c18-9982-a2e64cdda4fd None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.778910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357434fc-8f6a-4c18-9982-a2e64cdda4fd None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.779217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357434fc-8f6a-4c18-9982-a2e64cdda4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.809216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-357434fc-8f6a-4c18-9982-a2e64cdda4fd None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:40.810554 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-357434fc-8f6a-4c18-9982-a2e64cdda4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:40.892506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 787/1578] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:40.892506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357434fc-8f6a-4c18-9982-a2e64cdda4fd None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:40.903909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62321fd9-511f-453b-9790-edef3ee8c996 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.966021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc360b0-1e17-4da4-b469-8e20f179f646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.966665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc360b0-1e17-4da4-b469-8e20f179f646 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.966951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc360b0-1e17-4da4-b469-8e20f179f646 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.967222 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc360b0-1e17-4da4-b469-8e20f179f646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:40.979032 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357434fc-8f6a-4c18-9982-a2e64cdda4fd None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:40.982192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc360b0-1e17-4da4-b469-8e20f179f646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:40.985560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9200db-e01d-482c-a621-cedd2e2d85aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:40.985831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9200db-e01d-482c-a621-cedd2e2d85aa service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:40.986249 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9200db-e01d-482c-a621-cedd2e2d85aa service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:40.990561 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9200db-e01d-482c-a621-cedd2e2d85aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.010025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc360b0-1e17-4da4-b469-8e20f179f646 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.020884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 792/1579] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:41.021732 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc360b0-1e17-4da4-b469-8e20f179f646 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.033272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc360b0-1e17-4da4-b469-8e20f179f646 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.040153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda28c2-0cae-4bcd-885f-af4aae57a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.041042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda28c2-0cae-4bcd-885f-af4aae57a17a admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.041758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda28c2-0cae-4bcd-885f-af4aae57a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.042278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda28c2-0cae-4bcd-885f-af4aae57a17a admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.043192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda28c2-0cae-4bcd-885f-af4aae57a17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.072270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda28c2-0cae-4bcd-885f-af4aae57a17a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.104869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 793/1580] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:41 2021] POST /identity/v3/users => generated 295 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:41.105934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda28c2-0cae-4bcd-885f-af4aae57a17a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.135337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda28c2-0cae-4bcd-885f-af4aae57a17a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.144167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aa1a9-f1c3-43d7-b8d0-e4cb8c82be14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.145048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aa1a9-f1c3-43d7-b8d0-e4cb8c82be14 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.145421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aa1a9-f1c3-43d7-b8d0-e4cb8c82be14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.145813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aa1a9-f1c3-43d7-b8d0-e4cb8c82be14 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.146917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aa1a9-f1c3-43d7-b8d0-e4cb8c82be14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.147061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9200db-e01d-482c-a621-cedd2e2d85aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.176110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aa1a9-f1c3-43d7-b8d0-e4cb8c82be14 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.194401 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 794/1581] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:41.195324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aa1a9-f1c3-43d7-b8d0-e4cb8c82be14 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.200371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9200db-e01d-482c-a621-cedd2e2d85aa service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.212213 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aa1a9-f1c3-43d7-b8d0-e4cb8c82be14 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.212385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 788/1582] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:40 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:41.218505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134efdf-b2f4-4599-ad68-e8f0053fea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.219506 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134efdf-b2f4-4599-ad68-e8f0053fea3e admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.219867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134efdf-b2f4-4599-ad68-e8f0053fea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.220207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134efdf-b2f4-4599-ad68-e8f0053fea3e admin admin] PATH_INFO: `/v3/projects/3b02e727e9284148b9648cc8f69a9070/users/1285bf2b40904d24ad796261f2762906/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.222482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134efdf-b2f4-4599-ad68-e8f0053fea3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b02e727e9284148b9648cc8f69a9070, user_id=1285bf2b40904d24ad796261f2762906, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.227517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9200db-e01d-482c-a621-cedd2e2d85aa service nova] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.248523 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9200db-e01d-482c-a621-cedd2e2d85aa service nova] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.258614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f322ba-676b-4e3d-9f8c-3c3ecb94b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.260164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134efdf-b2f4-4599-ad68-e8f0053fea3e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.263804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f322ba-676b-4e3d-9f8c-3c3ecb94b708 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.264293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f322ba-676b-4e3d-9f8c-3c3ecb94b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.265015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f322ba-676b-4e3d-9f8c-3c3ecb94b708 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.266183 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f322ba-676b-4e3d-9f8c-3c3ecb94b708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.282282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 795/1583] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:41 2021] PUT /identity/v3/projects/3b02e727e9284148b9648cc8f69a9070/users/1285bf2b40904d24ad796261f2762906/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:41.283551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134efdf-b2f4-4599-ad68-e8f0053fea3e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.332531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f322ba-676b-4e3d-9f8c-3c3ecb94b708 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.361925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134efdf-b2f4-4599-ad68-e8f0053fea3e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.366598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fe1fe-2df5-4c22-9d0a-3e152ccd2a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.367218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fe1fe-2df5-4c22-9d0a-3e152ccd2a0b service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.367559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fe1fe-2df5-4c22-9d0a-3e152ccd2a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.368148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fe1fe-2df5-4c22-9d0a-3e152ccd2a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.374104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 789/1584] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:41 2021] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:41.375085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f322ba-676b-4e3d-9f8c-3c3ecb94b708 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.396132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f322ba-676b-4e3d-9f8c-3c3ecb94b708 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.483843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e79f0-5786-49c9-a4c4-6b9ebcaa7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.484599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e79f0-5786-49c9-a4c4-6b9ebcaa7788 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.485031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e79f0-5786-49c9-a4c4-6b9ebcaa7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.485411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e79f0-5786-49c9-a4c4-6b9ebcaa7788 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.486291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e79f0-5786-49c9-a4c4-6b9ebcaa7788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.516955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e79f0-5786-49c9-a4c4-6b9ebcaa7788 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.527350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fe1fe-2df5-4c22-9d0a-3e152ccd2a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.537013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 790/1585] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:41.539722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e79f0-5786-49c9-a4c4-6b9ebcaa7788 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.568240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e79f0-5786-49c9-a4c4-6b9ebcaa7788 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.588300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a5ca9-6b04-4ada-b70a-7a6b3eb4d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.589155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5ca9-6b04-4ada-b70a-7a6b3eb4d672 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.589439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5ca9-6b04-4ada-b70a-7a6b3eb4d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.589718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5ca9-6b04-4ada-b70a-7a6b3eb4d672 admin admin] PATH_INFO: `/v3/projects/79574da0c70e41ec841b21ab095c2ed0/users/7041d6d6d14843249a0a5690ce6af100/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.602679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fe1fe-2df5-4c22-9d0a-3e152ccd2a0b service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.624877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 796/1586] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:41.626132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fe1fe-2df5-4c22-9d0a-3e152ccd2a0b service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.635577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a5ca9-6b04-4ada-b70a-7a6b3eb4d672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79574da0c70e41ec841b21ab095c2ed0, user_id=7041d6d6d14843249a0a5690ce6af100, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.655027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fe1fe-2df5-4c22-9d0a-3e152ccd2a0b service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.670208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38f462-66e8-45c7-810b-51ecc249640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.670852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38f462-66e8-45c7-810b-51ecc249640a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.671047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38f462-66e8-45c7-810b-51ecc249640a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.671290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38f462-66e8-45c7-810b-51ecc249640a admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.672025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38f462-66e8-45c7-810b-51ecc249640a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.693332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a5ca9-6b04-4ada-b70a-7a6b3eb4d672 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.720961 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 791/1587] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:41 2021] PUT /identity/v3/projects/79574da0c70e41ec841b21ab095c2ed0/users/7041d6d6d14843249a0a5690ce6af100/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:41.720961 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a5ca9-6b04-4ada-b70a-7a6b3eb4d672 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.725262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38f462-66e8-45c7-810b-51ecc249640a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.758530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 797/1588] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:41.761876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38f462-66e8-45c7-810b-51ecc249640a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.795911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38f462-66e8-45c7-810b-51ecc249640a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.893504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a5ca9-6b04-4ada-b70a-7a6b3eb4d672 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.895053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56072eca-0836-4241-9b05-0a387c1fb1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.896118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072eca-0836-4241-9b05-0a387c1fb1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.896396 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072eca-0836-4241-9b05-0a387c1fb1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.896677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072eca-0836-4241-9b05-0a387c1fb1fe admin admin] PATH_INFO: `/v3/projects/aa9ac78aa5c54f08bb1a09aeccb78458/users/88651aae02a74476843a9d968aff3361/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.901305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dfd21-fbb2-4df1-8d6e-c7ad06924289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:41.902485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dfd21-fbb2-4df1-8d6e-c7ad06924289 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:41.902966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dfd21-fbb2-4df1-8d6e-c7ad06924289 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:41.903397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dfd21-fbb2-4df1-8d6e-c7ad06924289 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:41.904374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dfd21-fbb2-4df1-8d6e-c7ad06924289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.919305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56072eca-0836-4241-9b05-0a387c1fb1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9ac78aa5c54f08bb1a09aeccb78458, user_id=88651aae02a74476843a9d968aff3361, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:41.937845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26dfd21-fbb2-4df1-8d6e-c7ad06924289 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.954952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 792/1589] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:41.955199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56072eca-0836-4241-9b05-0a387c1fb1fe admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:41.959967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dfd21-fbb2-4df1-8d6e-c7ad06924289 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:41.971748 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26dfd21-fbb2-4df1-8d6e-c7ad06924289 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:41.991121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 798/1590] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:41 2021] PUT /identity/v3/projects/aa9ac78aa5c54f08bb1a09aeccb78458/users/88651aae02a74476843a9d968aff3361/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:41.993247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56072eca-0836-4241-9b05-0a387c1fb1fe admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:42.076694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e967a-21a2-4d77-9f6e-06317e95cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:42.078216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e967a-21a2-4d77-9f6e-06317e95cbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:42.078993 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e967a-21a2-4d77-9f6e-06317e95cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:42.079526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e967a-21a2-4d77-9f6e-06317e95cbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:42.080402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e967a-21a2-4d77-9f6e-06317e95cbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:42.112599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e967a-21a2-4d77-9f6e-06317e95cbd7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:42.127737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 793/1591] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:42.128670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e967a-21a2-4d77-9f6e-06317e95cbd7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:42.149935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56072eca-0836-4241-9b05-0a387c1fb1fe admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:42.165480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0017b-a284-4cf4-9681-3343ac9000ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:42.166350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0017b-a284-4cf4-9681-3343ac9000ce admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:42.166831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0017b-a284-4cf4-9681-3343ac9000ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:42.167252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0017b-a284-4cf4-9681-3343ac9000ce admin admin] PATH_INFO: `/v3/projects/3b02e727e9284148b9648cc8f69a9070/users/1285bf2b40904d24ad796261f2762906/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:42.169267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0017b-a284-4cf4-9681-3343ac9000ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b02e727e9284148b9648cc8f69a9070, user_id=1285bf2b40904d24ad796261f2762906, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:42.222028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e967a-21a2-4d77-9f6e-06317e95cbd7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:42.225283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0017b-a284-4cf4-9681-3343ac9000ce admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:42.226676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd378c96-5e4b-48ea-9bdd-71289bdb22a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:42.227455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd378c96-5e4b-48ea-9bdd-71289bdb22a6 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:42.227882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd378c96-5e4b-48ea-9bdd-71289bdb22a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:42.228304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd378c96-5e4b-48ea-9bdd-71289bdb22a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:42.264216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 799/1592] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:41 2021] PUT /identity/v3/projects/3b02e727e9284148b9648cc8f69a9070/users/1285bf2b40904d24ad796261f2762906/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:42.265216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0017b-a284-4cf4-9681-3343ac9000ce admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:42.330955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd378c96-5e4b-48ea-9bdd-71289bdb22a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:42.369059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd378c96-5e4b-48ea-9bdd-71289bdb22a6 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:42.389132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 794/1593] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:42 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:42.390325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd378c96-5e4b-48ea-9bdd-71289bdb22a6 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:42.420932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd378c96-5e4b-48ea-9bdd-71289bdb22a6 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:42.449620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0017b-a284-4cf4-9681-3343ac9000ce admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:42.462052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe10d0-4e28-4776-b0c2-d8c47e516b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:42.466863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe10d0-4e28-4776-b0c2-d8c47e516b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:42.467271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe10d0-4e28-4776-b0c2-d8c47e516b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:42.467570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe10d0-4e28-4776-b0c2-d8c47e516b8d admin admin] PATH_INFO: `/v3/projects/19ea94337b4d42b78e06b019fbc02000/users/2e35e9a9f26842639f24033f00dbd6cd/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:42.520854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe10d0-4e28-4776-b0c2-d8c47e516b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ea94337b4d42b78e06b019fbc02000, user_id=2e35e9a9f26842639f24033f00dbd6cd, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:42.539825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4e229-b209-4f7c-be88-a95c2782469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:42.540626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4e229-b209-4f7c-be88-a95c2782469b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:42.541017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4e229-b209-4f7c-be88-a95c2782469b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:42.541682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4e229-b209-4f7c-be88-a95c2782469b admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:42.543171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4e229-b209-4f7c-be88-a95c2782469b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:42.590661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe10d0-4e28-4776-b0c2-d8c47e516b8d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:42.592843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4e229-b209-4f7c-be88-a95c2782469b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:42.616165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 795/1594] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:42 2021] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:42.616165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4e229-b209-4f7c-be88-a95c2782469b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:42.622317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 800/1595] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:42 2021] PUT /identity/v3/projects/19ea94337b4d42b78e06b019fbc02000/users/2e35e9a9f26842639f24033f00dbd6cd/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:42.622317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7534c8e-ef4b-4de7-93b1-7f26ca389e4a None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:42.622317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7534c8e-ef4b-4de7-93b1-7f26ca389e4a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:42.624821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7534c8e-ef4b-4de7-93b1-7f26ca389e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:42.635751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4e229-b209-4f7c-be88-a95c2782469b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:42.719193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d7534c8e-ef4b-4de7-93b1-7f26ca389e4a None None] MFA Rules not processed for user `1285bf2b40904d24ad796261f2762906`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:42.720440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d7534c8e-ef4b-4de7-93b1-7f26ca389e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:42.836860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a5fed-97ca-4747-a79e-d8e21c5faf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:42.839135 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a5fed-97ca-4747-a79e-d8e21c5faf17 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:42.839660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a5fed-97ca-4747-a79e-d8e21c5faf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:42.840142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a5fed-97ca-4747-a79e-d8e21c5faf17 admin admin] PATH_INFO: `/v3/projects/79574da0c70e41ec841b21ab095c2ed0/users/7041d6d6d14843249a0a5690ce6af100/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:42.843214 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a5fed-97ca-4747-a79e-d8e21c5faf17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79574da0c70e41ec841b21ab095c2ed0, user_id=7041d6d6d14843249a0a5690ce6af100, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:42.875285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a5fed-97ca-4747-a79e-d8e21c5faf17 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:42.886210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 801/1596] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:42 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:42.887441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7534c8e-ef4b-4de7-93b1-7f26ca389e4a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:42.890902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 796/1597] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:42 2021] PUT /identity/v3/projects/79574da0c70e41ec841b21ab095c2ed0/users/7041d6d6d14843249a0a5690ce6af100/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:42.892712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a5fed-97ca-4747-a79e-d8e21c5faf17 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:42.904366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7534c8e-ef4b-4de7-93b1-7f26ca389e4a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:43.007882 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1edb-7536-4c91-9573-908298c1a861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:43.008946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1edb-7536-4c91-9573-908298c1a861 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.009238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1edb-7536-4c91-9573-908298c1a861 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.009520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1edb-7536-4c91-9573-908298c1a861 admin admin] PATH_INFO: `/v3/projects/aa9ac78aa5c54f08bb1a09aeccb78458/users/88651aae02a74476843a9d968aff3361/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.011470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c1edb-7536-4c91-9573-908298c1a861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9ac78aa5c54f08bb1a09aeccb78458, user_id=88651aae02a74476843a9d968aff3361, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:43.040337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c1edb-7536-4c91-9573-908298c1a861 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:43.055097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 802/1598] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:42 2021] PUT /identity/v3/projects/aa9ac78aa5c54f08bb1a09aeccb78458/users/88651aae02a74476843a9d968aff3361/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:43.055097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1edb-7536-4c91-9573-908298c1a861 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:43.059146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a5fed-97ca-4747-a79e-d8e21c5faf17 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:43.209939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1edb-7536-4c91-9573-908298c1a861 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:43.226188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10895ed0-81b3-4d5a-be9d-6cf2c9eac47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:43.228382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10895ed0-81b3-4d5a-be9d-6cf2c9eac47c service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.228683 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10895ed0-81b3-4d5a-be9d-6cf2c9eac47c service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.228976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10895ed0-81b3-4d5a-be9d-6cf2c9eac47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.230711 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf83307-abea-4fc5-a408-9fa626bb37cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:43.231455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf83307-abea-4fc5-a408-9fa626bb37cc admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.231742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf83307-abea-4fc5-a408-9fa626bb37cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.232017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf83307-abea-4fc5-a408-9fa626bb37cc admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.235168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf83307-abea-4fc5-a408-9fa626bb37cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:43.293509 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf83307-abea-4fc5-a408-9fa626bb37cc admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:43.326321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 797/1599] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:42 2021] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:43.327497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf83307-abea-4fc5-a408-9fa626bb37cc admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:43.344782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf83307-abea-4fc5-a408-9fa626bb37cc admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:43.356768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42c7c2-3625-4fd5-b36c-3d923099a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:43.357497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42c7c2-3625-4fd5-b36c-3d923099a3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.357856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42c7c2-3625-4fd5-b36c-3d923099a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.358298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42c7c2-3625-4fd5-b36c-3d923099a3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.360266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42c7c2-3625-4fd5-b36c-3d923099a3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:43.396349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10895ed0-81b3-4d5a-be9d-6cf2c9eac47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:43.404706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42c7c2-3625-4fd5-b36c-3d923099a3c3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:43.420370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 798/1600] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:43 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:43.422107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42c7c2-3625-4fd5-b36c-3d923099a3c3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:43.433634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42c7c2-3625-4fd5-b36c-3d923099a3c3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:43.443078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808cd8b-b29c-4654-8aca-bee2a95389ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:43.444250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808cd8b-b29c-4654-8aca-bee2a95389ed admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.444885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808cd8b-b29c-4654-8aca-bee2a95389ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.445485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808cd8b-b29c-4654-8aca-bee2a95389ed admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.447554 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808cd8b-b29c-4654-8aca-bee2a95389ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:43.461186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10895ed0-81b3-4d5a-be9d-6cf2c9eac47c service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:43.486118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 803/1601] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:43 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:43.486429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808cd8b-b29c-4654-8aca-bee2a95389ed admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:43.486625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10895ed0-81b3-4d5a-be9d-6cf2c9eac47c service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:43.512646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10895ed0-81b3-4d5a-be9d-6cf2c9eac47c service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:43.518549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0054e-95ab-4fc2-b09f-eb1f04446ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:43.519423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0054e-95ab-4fc2-b09f-eb1f04446ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.519750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0054e-95ab-4fc2-b09f-eb1f04446ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.520475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0054e-95ab-4fc2-b09f-eb1f04446ab0 admin admin] PATH_INFO: `/v3/projects/19ea94337b4d42b78e06b019fbc02000/users/2e35e9a9f26842639f24033f00dbd6cd/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.522737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 799/1602] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:43 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:43.524555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0054e-95ab-4fc2-b09f-eb1f04446ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ea94337b4d42b78e06b019fbc02000, user_id=2e35e9a9f26842639f24033f00dbd6cd, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:43.524964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808cd8b-b29c-4654-8aca-bee2a95389ed admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:43.546811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808cd8b-b29c-4654-8aca-bee2a95389ed admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:43.559658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ac4e1-aa03-4f3c-b379-25769d9574f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:43.560645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ac4e1-aa03-4f3c-b379-25769d9574f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.563353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ac4e1-aa03-4f3c-b379-25769d9574f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.563353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ac4e1-aa03-4f3c-b379-25769d9574f7 admin admin] PATH_INFO: `/v3/projects/79574da0c70e41ec841b21ab095c2ed0/users/7041d6d6d14843249a0a5690ce6af100/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.568089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ac4e1-aa03-4f3c-b379-25769d9574f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79574da0c70e41ec841b21ab095c2ed0, user_id=7041d6d6d14843249a0a5690ce6af100, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:43.590752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0054e-95ab-4fc2-b09f-eb1f04446ab0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:43.625548 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 804/1603] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:43 2021] PUT /identity/v3/projects/19ea94337b4d42b78e06b019fbc02000/users/2e35e9a9f26842639f24033f00dbd6cd/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:43.628813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0054e-95ab-4fc2-b09f-eb1f04446ab0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:43.636630 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ac4e1-aa03-4f3c-b379-25769d9574f7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:43.670489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 800/1604] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:43 2021] PUT /identity/v3/projects/79574da0c70e41ec841b21ab095c2ed0/users/7041d6d6d14843249a0a5690ce6af100/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:43.673572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ac4e1-aa03-4f3c-b379-25769d9574f7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:43.818456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ac4e1-aa03-4f3c-b379-25769d9574f7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:43.824248 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a1640-2fa5-422e-93d6-3205445b1782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:43.825310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1640-2fa5-422e-93d6-3205445b1782 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.825829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1640-2fa5-422e-93d6-3205445b1782 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.826367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1640-2fa5-422e-93d6-3205445b1782 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.827186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0054e-95ab-4fc2-b09f-eb1f04446ab0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:43.827591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a1640-2fa5-422e-93d6-3205445b1782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:43.840737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5f7cd-8902-4b23-b1e3-2928dd5840b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:43.842809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f7cd-8902-4b23-b1e3-2928dd5840b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.845246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f7cd-8902-4b23-b1e3-2928dd5840b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.845563 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f7cd-8902-4b23-b1e3-2928dd5840b1 admin admin] PATH_INFO: `/v3/projects/aa9ac78aa5c54f08bb1a09aeccb78458/users/88651aae02a74476843a9d968aff3361/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.849962 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5f7cd-8902-4b23-b1e3-2928dd5840b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9ac78aa5c54f08bb1a09aeccb78458, user_id=88651aae02a74476843a9d968aff3361, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:43.859346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a1640-2fa5-422e-93d6-3205445b1782 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:43.874007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 801/1605] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:43 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:43.877791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5900b64-1d2c-4b7c-80c0-38978d38fa96 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:43.878377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5900b64-1d2c-4b7c-80c0-38978d38fa96 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:43.878873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5900b64-1d2c-4b7c-80c0-38978d38fa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:43.920485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5f7cd-8902-4b23-b1e3-2928dd5840b1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:43.931156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c5900b64-1d2c-4b7c-80c0-38978d38fa96 None None] MFA Rules not processed for user `7041d6d6d14843249a0a5690ce6af100`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:43.933222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c5900b64-1d2c-4b7c-80c0-38978d38fa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:43.955629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 805/1606] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:43 2021] PUT /identity/v3/projects/aa9ac78aa5c54f08bb1a09aeccb78458/users/88651aae02a74476843a9d968aff3361/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:43.955629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5f7cd-8902-4b23-b1e3-2928dd5840b1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:44.120859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5f7cd-8902-4b23-b1e3-2928dd5840b1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:44.131394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 802/1607] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:43 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:44.132858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5900b64-1d2c-4b7c-80c0-38978d38fa96 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:44.136905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ff6a-7f29-4e82-bbac-812e30b566df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:44.137696 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ff6a-7f29-4e82-bbac-812e30b566df service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:44.138002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ff6a-7f29-4e82-bbac-812e30b566df service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:44.138290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ff6a-7f29-4e82-bbac-812e30b566df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:44.163097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5900b64-1d2c-4b7c-80c0-38978d38fa96 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:44.284445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c51706-249f-4699-b348-a1f809dc64f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:44.285420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c51706-249f-4699-b348-a1f809dc64f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:44.290397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c51706-249f-4699-b348-a1f809dc64f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:44.290737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c51706-249f-4699-b348-a1f809dc64f2 admin admin] PATH_INFO: `/v3/projects/19ea94337b4d42b78e06b019fbc02000/users/2e35e9a9f26842639f24033f00dbd6cd/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:44.294911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c51706-249f-4699-b348-a1f809dc64f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ea94337b4d42b78e06b019fbc02000, user_id=2e35e9a9f26842639f24033f00dbd6cd, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:44.299894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243ff6a-7f29-4e82-bbac-812e30b566df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:44.366043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243ff6a-7f29-4e82-bbac-812e30b566df service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:44.366721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c51706-249f-4699-b348-a1f809dc64f2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:44.397030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 803/1608] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:44 2021] PUT /identity/v3/projects/19ea94337b4d42b78e06b019fbc02000/users/2e35e9a9f26842639f24033f00dbd6cd/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:44.397030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34202-c189-49c3-b666-4f7ec8b8f4d2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:44.397030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34202-c189-49c3-b666-4f7ec8b8f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:44.397030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34202-c189-49c3-b666-4f7ec8b8f4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:44.397555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 806/1609] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:43 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:44.397555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ff6a-7f29-4e82-bbac-812e30b566df service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:44.423954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ff6a-7f29-4e82-bbac-812e30b566df service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:44.439631 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-30a34202-c189-49c3-b666-4f7ec8b8f4d2 None None] MFA Rules not processed for user `88651aae02a74476843a9d968aff3361`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:44.441130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-30a34202-c189-49c3-b666-4f7ec8b8f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:44.564761 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 804/1610] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:44 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:44.567294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ebef9-19ca-4a65-90d9-e28374ec853e None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:44.568252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ebef9-19ca-4a65-90d9-e28374ec853e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:44.569380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ebef9-19ca-4a65-90d9-e28374ec853e None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:44.573921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 805/1611] 10.222.0.67 () {54 vars in 959 bytes} [Thu Dec 16 14:37:44 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:44.575696 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd7bf-0fb6-463c-abe7-b7ad0d8b1935 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:44.576220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd7bf-0fb6-463c-abe7-b7ad0d8b1935 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:44.576751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd7bf-0fb6-463c-abe7-b7ad0d8b1935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:44.597468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc733086-13a0-4a30-8ef5-8d92cfd1a89c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:44.598171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc733086-13a0-4a30-8ef5-8d92cfd1a89c service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:44.598460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc733086-13a0-4a30-8ef5-8d92cfd1a89c service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:44.598742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc733086-13a0-4a30-8ef5-8d92cfd1a89c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:44.627010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-225fd7bf-0fb6-463c-abe7-b7ad0d8b1935 None None] MFA Rules not processed for user `2e35e9a9f26842639f24033f00dbd6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:44.628969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-225fd7bf-0fb6-463c-abe7-b7ad0d8b1935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:44.737754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc733086-13a0-4a30-8ef5-8d92cfd1a89c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:44.763599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc733086-13a0-4a30-8ef5-8d92cfd1a89c service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:44.778726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 806/1612] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:44 2021] POST /identity/v3/auth/tokens => generated 3731 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:44.778726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39525550-2032-4b14-85ce-9cea0b9378e8 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:44.778726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39525550-2032-4b14-85ce-9cea0b9378e8 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:44.780829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39525550-2032-4b14-85ce-9cea0b9378e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:44.790190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 807/1613] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:44 2021] GET /identity/v3/auth/tokens => generated 3779 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:44.815385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc733086-13a0-4a30-8ef5-8d92cfd1a89c service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:44.834731 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc733086-13a0-4a30-8ef5-8d92cfd1a89c service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:44.839180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475009d6-00fc-42b0-ac3c-8ecfec46824f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:44.840059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475009d6-00fc-42b0-ac3c-8ecfec46824f service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:44.840059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475009d6-00fc-42b0-ac3c-8ecfec46824f service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:44.840346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475009d6-00fc-42b0-ac3c-8ecfec46824f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:44.879950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-39525550-2032-4b14-85ce-9cea0b9378e8 None None] MFA Rules not processed for user `f2bcc9f013f14ed89f5e94591f170b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:44.880193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-39525550-2032-4b14-85ce-9cea0b9378e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:45.011216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475009d6-00fc-42b0-ac3c-8ecfec46824f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:45.051444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475009d6-00fc-42b0-ac3c-8ecfec46824f service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:45.064333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 808/1614] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:44 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:37:45.065604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475009d6-00fc-42b0-ac3c-8ecfec46824f service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:45.079128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 807/1615] 10.222.0.67 () {58 vars in 1056 bytes} [Thu Dec 16 14:37:44 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:45.080131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475009d6-00fc-42b0-ac3c-8ecfec46824f service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:45.086803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733c02-a484-411a-9393-d3a22c66a953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:45.088334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733c02-a484-411a-9393-d3a22c66a953 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:45.088767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733c02-a484-411a-9393-d3a22c66a953 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:45.089207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733c02-a484-411a-9393-d3a22c66a953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:45.104038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733c02-a484-411a-9393-d3a22c66a953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:45.145075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733c02-a484-411a-9393-d3a22c66a953 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:45.155711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 809/1616] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:45 2021] GET /identity/v3/auth/tokens => generated 3731 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:45.382091 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39525550-2032-4b14-85ce-9cea0b9378e8 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:45.396525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39525550-2032-4b14-85ce-9cea0b9378e8 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:45.405828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae526691-e45a-4826-9582-5b6e9d14210d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:45.407924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae526691-e45a-4826-9582-5b6e9d14210d service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:45.409440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae526691-e45a-4826-9582-5b6e9d14210d service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:45.410725 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae526691-e45a-4826-9582-5b6e9d14210d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:45.443679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae526691-e45a-4826-9582-5b6e9d14210d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:45.476118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313a59d-2d03-4cf8-a88d-1256aa05e642 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:45.476465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313a59d-2d03-4cf8-a88d-1256aa05e642 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:45.476744 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313a59d-2d03-4cf8-a88d-1256aa05e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:45.524610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae526691-e45a-4826-9582-5b6e9d14210d service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:45.563326 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 808/1617] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:45 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:45.568993 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0313a59d-2d03-4cf8-a88d-1256aa05e642 None None] MFA Rules not processed for user `108e1d33249b49dcb6e3779514bc7a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:45.571203 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0313a59d-2d03-4cf8-a88d-1256aa05e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:45.674051 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 810/1618] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:45 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:45.682042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d378459-adc5-4898-bda8-b76105c15311 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:45.682423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d378459-adc5-4898-bda8-b76105c15311 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:45.682701 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d378459-adc5-4898-bda8-b76105c15311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:45.729446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-5d378459-adc5-4898-bda8-b76105c15311 None None] MFA Rules not processed for user `108e1d33249b49dcb6e3779514bc7a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:45.732572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5d378459-adc5-4898-bda8-b76105c15311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:45.753588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 809/1619] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:45 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:37:45.762496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313a59d-2d03-4cf8-a88d-1256aa05e642 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:45.790241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313a59d-2d03-4cf8-a88d-1256aa05e642 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:45.800873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7798a-4669-4b47-8c49-a7c50673c786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:45.801838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7798a-4669-4b47-8c49-a7c50673c786 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:45.805479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7798a-4669-4b47-8c49-a7c50673c786 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:45.806062 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7798a-4669-4b47-8c49-a7c50673c786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:45.828434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7798a-4669-4b47-8c49-a7c50673c786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:45.888503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7798a-4669-4b47-8c49-a7c50673c786 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:45.912823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 811/1620] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:45 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:46.933545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d378459-adc5-4898-bda8-b76105c15311 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:46.981788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d378459-adc5-4898-bda8-b76105c15311 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:46.998303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac6a2d-0cea-4d31-9907-2b0321b9ec5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:46.999018 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac6a2d-0cea-4d31-9907-2b0321b9ec5d service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:46.999312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac6a2d-0cea-4d31-9907-2b0321b9ec5d service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:46.999594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac6a2d-0cea-4d31-9907-2b0321b9ec5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:47.284811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac6a2d-0cea-4d31-9907-2b0321b9ec5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:47.354186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac6a2d-0cea-4d31-9907-2b0321b9ec5d service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:47.367501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 810/1621] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:46 2021] GET /identity/v3/auth/tokens => generated 3664 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:47.569908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa3dfd-65e8-4f1d-92c6-5b793e39ead7 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:47.570750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa3dfd-65e8-4f1d-92c6-5b793e39ead7 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:47.571157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa3dfd-65e8-4f1d-92c6-5b793e39ead7 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:47.574389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 812/1622] 10.222.0.67 () {54 vars in 912 bytes} [Thu Dec 16 14:37:47 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:47.582386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbbb60-294d-4e4f-9d3a-fd1c8475f65b None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:47.583491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbbb60-294d-4e4f-9d3a-fd1c8475f65b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:47.584031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbbb60-294d-4e4f-9d3a-fd1c8475f65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:47.677868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa3dfd-65e8-4f1d-92c6-5b793e39ead7 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:47.848946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-24cbbb60-294d-4e4f-9d3a-fd1c8475f65b None None] MFA Rules not processed for user `20905ef1afa847bc8f2f6f6e335f8bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:47.860691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-24cbbb60-294d-4e4f-9d3a-fd1c8475f65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:48.040271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 811/1623] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Dec 16 14:37:47 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:48.080101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa3dfd-65e8-4f1d-92c6-5b793e39ead7 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:48.086771 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbbb60-294d-4e4f-9d3a-fd1c8475f65b None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:48.096409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbbb60-294d-4e4f-9d3a-fd1c8475f65b None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:48.097705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:48.099270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:48.099739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:48.100176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] PATH_INFO: `/v3/users/f0d8e37ea7764ab0ab75e82b2dbd9f9c` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:48.107589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d8e37ea7764ab0ab75e82b2dbd9f9c)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:48.114601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1eeb84-b778-4933-826d-efe0a74e15ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:48.116343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1eeb84-b778-4933-826d-efe0a74e15ff service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:48.116869 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1eeb84-b778-4933-826d-efe0a74e15ff service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:48.117386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1eeb84-b778-4933-826d-efe0a74e15ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:48.140659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1eeb84-b778-4933-826d-efe0a74e15ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:48.206343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1eeb84-b778-4933-826d-efe0a74e15ff service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:48.234161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 812/1624] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:48 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:37:48.244220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:48.373722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d8e37ea7764ab0ab75e82b2dbd9f9c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:48.419284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d8e37ea7764ab0ab75e82b2dbd9f9c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:48.465621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d8e37ea7764ab0ab75e82b2dbd9f9c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:48.466443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d8e37ea7764ab0ab75e82b2dbd9f9c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:48.481316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d8e37ea7764ab0ab75e82b2dbd9f9c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:48.496882 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 813/1625] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:37:47 2021] DELETE /identity/v3/users/f0d8e37ea7764ab0ab75e82b2dbd9f9c => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:37:48.502690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0657585-3b64-499c-88e0-c8b43c649b16 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:48.503116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0657585-3b64-499c-88e0-c8b43c649b16 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:48.503528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0657585-3b64-499c-88e0-c8b43c649b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:48.571894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f0657585-3b64-499c-88e0-c8b43c649b16 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:48.573388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f0657585-3b64-499c-88e0-c8b43c649b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:48.792147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 813/1626] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:48.834510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:48.835890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:48.988656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123863-1948-4edd-899c-4cbbb0d789ca admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:48.992594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498eff2-5d6b-450c-8d2e-67256109d1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:48.993295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498eff2-5d6b-450c-8d2e-67256109d1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:48.993583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498eff2-5d6b-450c-8d2e-67256109d1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:48.994328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498eff2-5d6b-450c-8d2e-67256109d1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:49.014279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498eff2-5d6b-450c-8d2e-67256109d1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:49.044128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498eff2-5d6b-450c-8d2e-67256109d1c7 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:49.059477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 814/1627] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:49.799920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05031cae-33dd-43ac-bcf7-7944993b67ca None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:49.800458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05031cae-33dd-43ac-bcf7-7944993b67ca None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:49.800566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05031cae-33dd-43ac-bcf7-7944993b67ca None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:49.802682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 814/1628] 10.222.0.67 () {54 vars in 960 bytes} [Thu Dec 16 14:37:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:37:49.808478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c266140-91d2-4cfe-a94e-74c5c34d7fcc None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:49.809239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c266140-91d2-4cfe-a94e-74c5c34d7fcc None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:49.809591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c266140-91d2-4cfe-a94e-74c5c34d7fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:49.868986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6c266140-91d2-4cfe-a94e-74c5c34d7fcc None None] MFA Rules not processed for user `15e7b1dc56e949f2adb1744b492187a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:49.875206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6c266140-91d2-4cfe-a94e-74c5c34d7fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:50.074647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 815/1629] 10.222.0.67 () {58 vars in 1057 bytes} [Thu Dec 16 14:37:49 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:50.082439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05031cae-33dd-43ac-bcf7-7944993b67ca None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:50.110585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05031cae-33dd-43ac-bcf7-7944993b67ca None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:50.127604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:50.128383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:50.128813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:50.129196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:50.131300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:50.156220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:50.219542 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:50.245239 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 815/1630] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:50 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:50.635149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c266140-91d2-4cfe-a94e-74c5c34d7fcc None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:50.636840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6c266140-91d2-4cfe-a94e-74c5c34d7fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:50.665590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c266140-91d2-4cfe-a94e-74c5c34d7fcc None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:50.689217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9068681-e625-442f-bee1-cf37bc983d2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:50.691545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9068681-e625-442f-bee1-cf37bc983d2c service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:50.692659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9068681-e625-442f-bee1-cf37bc983d2c service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:50.693470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9068681-e625-442f-bee1-cf37bc983d2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:50.695727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a9068681-e625-442f-bee1-cf37bc983d2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:50.746126 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9068681-e625-442f-bee1-cf37bc983d2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:50.833311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9068681-e625-442f-bee1-cf37bc983d2c service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:50.861787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 816/1631] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:50 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:51.446511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:51.450948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:51.501462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fa636-bc05-40d2-8da4-26731a480f8b service placement] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:51.506909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:51.507770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:51.508112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:51.508398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] PATH_INFO: `/v3/projects/0212998f80a74b93ab8101caf0416034` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:51.509787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0212998f80a74b93ab8101caf0416034)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:51.611394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:51.829208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0212998f80a74b93ab8101caf0416034', 'request_id': 'req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:51.844633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0212998f80a74b93ab8101caf0416034', 'request_id': 'req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:51.860606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0212998f80a74b93ab8101caf0416034', 'request_id': 'req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:51.880514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] The token cache is being invalidate because project 0212998f80a74b93ab8101caf0416034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:37:51.881364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:51.882931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dd6dbcf2-caef-4eb9-8f03-dd5c6ceab07c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:51.885086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 816/1632] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:37:51 2021] DELETE /identity/v3/projects/0212998f80a74b93ab8101caf0416034 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:51.890423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9068681-e625-442f-bee1-cf37bc983d2c service placement] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:51.914377 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9068681-e625-442f-bee1-cf37bc983d2c service placement] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:52.108597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:52.109493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:52.109782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:52.110097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] PATH_INFO: `/v3/users/7041d6d6d14843249a0a5690ce6af100` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:52.121590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7041d6d6d14843249a0a5690ce6af100)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:52.249239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:52.425720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7041d6d6d14843249a0a5690ce6af100'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:52.473231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7041d6d6d14843249a0a5690ce6af100'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:52.496983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7041d6d6d14843249a0a5690ce6af100'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:52.498357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7041d6d6d14843249a0a5690ce6af100'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:52.514133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7041d6d6d14843249a0a5690ce6af100'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:52.553752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 817/1633] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:37:51 2021] DELETE /identity/v3/users/7041d6d6d14843249a0a5690ce6af100 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:52.950916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc4aa-c1ff-4fff-82e6-bf2e1a6ee582 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:52.951511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc4aa-c1ff-4fff-82e6-bf2e1a6ee582 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:52.951785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc4aa-c1ff-4fff-82e6-bf2e1a6ee582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:53.003119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-808fc4aa-c1ff-4fff-82e6-bf2e1a6ee582 None None] MFA Rules not processed for user `6c6c792676f1498e98f638a268abf1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:53.004616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-808fc4aa-c1ff-4fff-82e6-bf2e1a6ee582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:53.182082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 817/1634] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:52 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:53.196200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:53.198444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:53.342487 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dff9a-58d3-4430-a310-5546530c0502 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:53.352732 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91b0c-a275-4a37-b386-2b17401dbd79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:53.353931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91b0c-a275-4a37-b386-2b17401dbd79 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:53.356406 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91b0c-a275-4a37-b386-2b17401dbd79 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:53.357196 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91b0c-a275-4a37-b386-2b17401dbd79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:53.374656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c91b0c-a275-4a37-b386-2b17401dbd79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:53.463237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c91b0c-a275-4a37-b386-2b17401dbd79 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:53.479526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 818/1635] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:53 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:53.522907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fc4aa-c1ff-4fff-82e6-bf2e1a6ee582 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:53.524406 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-808fc4aa-c1ff-4fff-82e6-bf2e1a6ee582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:53.691366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fc4aa-c1ff-4fff-82e6-bf2e1a6ee582 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:53.696775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:53.697684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:53.697910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:53.698239 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] PATH_INFO: `/v3/projects/79574da0c70e41ec841b21ab095c2ed0` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:53.699772 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79574da0c70e41ec841b21ab095c2ed0)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:53.737399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:53.841893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79574da0c70e41ec841b21ab095c2ed0', 'request_id': 'req-e981685a-808b-4327-a650-7700c7bf2e35'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:53.866158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79574da0c70e41ec841b21ab095c2ed0', 'request_id': 'req-e981685a-808b-4327-a650-7700c7bf2e35'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:53.879341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79574da0c70e41ec841b21ab095c2ed0', 'request_id': 'req-e981685a-808b-4327-a650-7700c7bf2e35'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:53.897476 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] The token cache is being invalidate because project 79574da0c70e41ec841b21ab095c2ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:37:53.897801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:53.898472 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e981685a-808b-4327-a650-7700c7bf2e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:37:53.901147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 818/1636] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:37:53 2021] DELETE /identity/v3/projects/79574da0c70e41ec841b21ab095c2ed0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:37:53.905934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f853b-2b4d-4074-bd05-8b8e29d7ae65 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:53.906525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f853b-2b4d-4074-bd05-8b8e29d7ae65 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:53.906807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f853b-2b4d-4074-bd05-8b8e29d7ae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:53.960848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-af6f853b-2b4d-4074-bd05-8b8e29d7ae65 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:53.967365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-af6f853b-2b4d-4074-bd05-8b8e29d7ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:54.048016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9b909-d31e-420f-ba33-dc43ee54cf68 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:54.049089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9b909-d31e-420f-ba33-dc43ee54cf68 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:54.049657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9b909-d31e-420f-ba33-dc43ee54cf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:54.143071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-97a9b909-d31e-420f-ba33-dc43ee54cf68 None None] MFA Rules not processed for user `0d72966786b641f48edda655d2d0ba45`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:54.143382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-97a9b909-d31e-420f-ba33-dc43ee54cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:54.184951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 819/1637] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:54.250736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f02b1-0b48-432d-80ce-7d66bdd00b2c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:54.251433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f02b1-0b48-432d-80ce-7d66bdd00b2c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:54.251433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f02b1-0b48-432d-80ce-7d66bdd00b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:54.298160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5e6f02b1-0b48-432d-80ce-7d66bdd00b2c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:54.304758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5e6f02b1-0b48-432d-80ce-7d66bdd00b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:54.326850 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 820/1638] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:37:54.331099 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f02b1-0b48-432d-80ce-7d66bdd00b2c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:54.350475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f02b1-0b48-432d-80ce-7d66bdd00b2c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:54.351420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 819/1639] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:54 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:37:54.363891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9b909-d31e-420f-ba33-dc43ee54cf68 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:54.367039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-97a9b909-d31e-420f-ba33-dc43ee54cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:54.370739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cea17-4ffe-4d55-b68f-1fc7627da0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:54.373068 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cea17-4ffe-4d55-b68f-1fc7627da0cf admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:54.373799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cea17-4ffe-4d55-b68f-1fc7627da0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:54.374400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cea17-4ffe-4d55-b68f-1fc7627da0cf admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:54.375350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cea17-4ffe-4d55-b68f-1fc7627da0cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:37:54.376131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cea17-4ffe-4d55-b68f-1fc7627da0cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:54.474012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cea17-4ffe-4d55-b68f-1fc7627da0cf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:54.509334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 821/1640] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:37:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:37:54.514484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cea17-4ffe-4d55-b68f-1fc7627da0cf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:54.544595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cea17-4ffe-4d55-b68f-1fc7627da0cf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:54.554638 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0867670-2026-415c-9096-bed4c05c93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:54.555991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0867670-2026-415c-9096-bed4c05c93c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:54.557229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0867670-2026-415c-9096-bed4c05c93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:54.557970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0867670-2026-415c-9096-bed4c05c93c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:54.561604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9b909-d31e-420f-ba33-dc43ee54cf68 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:54.566193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839272c2-5e07-4c6c-889c-f4fd3277c096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:54.567219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839272c2-5e07-4c6c-889c-f4fd3277c096 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:54.567666 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839272c2-5e07-4c6c-889c-f4fd3277c096 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:54.568335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839272c2-5e07-4c6c-889c-f4fd3277c096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:54.577559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0867670-2026-415c-9096-bed4c05c93c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:54.578325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839272c2-5e07-4c6c-889c-f4fd3277c096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:54.614969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839272c2-5e07-4c6c-889c-f4fd3277c096 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:54.639213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 820/1641] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:54 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:37:54.718650 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0867670-2026-415c-9096-bed4c05c93c7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:54.791338 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 822/1642] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:54 2021] POST /identity/v3/projects => generated 363 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:37:54.795783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839272c2-5e07-4c6c-889c-f4fd3277c096 service nova] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:54.821785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839272c2-5e07-4c6c-889c-f4fd3277c096 service nova] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:55.021881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbc3c2-7a13-4379-9581-cc571df787c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:55.024686 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbc3c2-7a13-4379-9581-cc571df787c9 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:55.025258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbc3c2-7a13-4379-9581-cc571df787c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:55.026181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbc3c2-7a13-4379-9581-cc571df787c9 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:55.028044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbc3c2-7a13-4379-9581-cc571df787c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:55.103213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbc3c2-7a13-4379-9581-cc571df787c9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:55.199660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 821/1643] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:54 2021] POST /identity/v3/users => generated 282 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:55.204492 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0867670-2026-415c-9096-bed4c05c93c7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:55.220705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0867670-2026-415c-9096-bed4c05c93c7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:55.231869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627a09d-6e6e-4fad-bf5b-6001bcf78363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:55.232826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627a09d-6e6e-4fad-bf5b-6001bcf78363 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:55.235628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627a09d-6e6e-4fad-bf5b-6001bcf78363 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:55.236564 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627a09d-6e6e-4fad-bf5b-6001bcf78363 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:55.241173 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627a09d-6e6e-4fad-bf5b-6001bcf78363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:55.308457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627a09d-6e6e-4fad-bf5b-6001bcf78363 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:55.332380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 823/1644] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:55 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:55.337940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbc3c2-7a13-4379-9581-cc571df787c9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:55.370748 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbc3c2-7a13-4379-9581-cc571df787c9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:55.421543 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a0d80-9be8-4f4e-920a-80260a088f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:55.422650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a0d80-9be8-4f4e-920a-80260a088f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:55.423413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a0d80-9be8-4f4e-920a-80260a088f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:55.424158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a0d80-9be8-4f4e-920a-80260a088f4a admin admin] PATH_INFO: `/v3/projects/9d55ceaabb0443aa964ba5050cf5feff/users/074cec530f3b4f6a82f839cee2528010/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:55.548808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a0d80-9be8-4f4e-920a-80260a088f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d55ceaabb0443aa964ba5050cf5feff, user_id=074cec530f3b4f6a82f839cee2528010, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:55.675555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a0d80-9be8-4f4e-920a-80260a088f4a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:55.722856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 822/1645] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:55 2021] PUT /identity/v3/projects/9d55ceaabb0443aa964ba5050cf5feff/users/074cec530f3b4f6a82f839cee2528010/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:55.737059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbeff8-7032-43b0-8d21-902f087f183b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:55.737535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbeff8-7032-43b0-8d21-902f087f183b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:55.737969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbeff8-7032-43b0-8d21-902f087f183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:55.819212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5edbeff8-7032-43b0-8d21-902f087f183b None None] MFA Rules not processed for user `074cec530f3b4f6a82f839cee2528010`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:55.822481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5edbeff8-7032-43b0-8d21-902f087f183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:56.089124 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 824/1646] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:55 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:56.090111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a0d80-9be8-4f4e-920a-80260a088f4a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:56.212141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a0d80-9be8-4f4e-920a-80260a088f4a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:56.225900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a511883-9800-464e-9e9c-d7a72483aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:56.226573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a511883-9800-464e-9e9c-d7a72483aa12 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:56.226827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a511883-9800-464e-9e9c-d7a72483aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:56.227269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a511883-9800-464e-9e9c-d7a72483aa12 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:56.228077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a511883-9800-464e-9e9c-d7a72483aa12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:56.266954 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a511883-9800-464e-9e9c-d7a72483aa12 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:56.342572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 823/1647] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:37:56 2021] POST /identity/v3/projects => generated 365 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:56.349106 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbeff8-7032-43b0-8d21-902f087f183b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:56.364577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbeff8-7032-43b0-8d21-902f087f183b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:56.560602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c2a0c-0229-4373-870b-2a0e3830e8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:56.562591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c2a0c-0229-4373-870b-2a0e3830e8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:56.563065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c2a0c-0229-4373-870b-2a0e3830e8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:56.563613 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c2a0c-0229-4373-870b-2a0e3830e8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:56.568047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c2a0c-0229-4373-870b-2a0e3830e8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:56.621437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c2a0c-0229-4373-870b-2a0e3830e8f9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:56.659297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 825/1648] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:37:56 2021] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:37:56.665576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a511883-9800-464e-9e9c-d7a72483aa12 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:56.685153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a511883-9800-464e-9e9c-d7a72483aa12 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:56.692878 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f088a-331a-44f8-b2f3-6697d54a02df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:56.693909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f088a-331a-44f8-b2f3-6697d54a02df admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:56.694447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f088a-331a-44f8-b2f3-6697d54a02df admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:56.694898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f088a-331a-44f8-b2f3-6697d54a02df admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:56.696335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f088a-331a-44f8-b2f3-6697d54a02df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:56.775940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f088a-331a-44f8-b2f3-6697d54a02df admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:56.807770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 824/1649] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:56 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:56.814268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c2a0c-0229-4373-870b-2a0e3830e8f9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:56.834396 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c2a0c-0229-4373-870b-2a0e3830e8f9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:56.844032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351ece2-14de-4951-9d16-3c78f085215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:56.845140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351ece2-14de-4951-9d16-3c78f085215b admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:56.845428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351ece2-14de-4951-9d16-3c78f085215b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:56.845705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351ece2-14de-4951-9d16-3c78f085215b admin admin] PATH_INFO: `/v3/projects/b8b140e10a9346e096f804c4d8f00355/users/d955e566b4ba4fc1ac2377056c1a2fbf/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:56.952081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351ece2-14de-4951-9d16-3c78f085215b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b140e10a9346e096f804c4d8f00355, user_id=d955e566b4ba4fc1ac2377056c1a2fbf, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:57.107578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351ece2-14de-4951-9d16-3c78f085215b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:57.156158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 826/1650] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:56 2021] PUT /identity/v3/projects/b8b140e10a9346e096f804c4d8f00355/users/d955e566b4ba4fc1ac2377056c1a2fbf/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:37:57.162460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f088a-331a-44f8-b2f3-6697d54a02df admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:57.221489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f088a-331a-44f8-b2f3-6697d54a02df admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:57.415365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aacee4-2318-48c9-b026-1e1e4e46a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:57.416831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aacee4-2318-48c9-b026-1e1e4e46a133 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:57.417213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aacee4-2318-48c9-b026-1e1e4e46a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:57.417544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aacee4-2318-48c9-b026-1e1e4e46a133 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:57.424069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aacee4-2318-48c9-b026-1e1e4e46a133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:57.485664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aacee4-2318-48c9-b026-1e1e4e46a133 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:57.504912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 825/1651] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:57.510077 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351ece2-14de-4951-9d16-3c78f085215b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:57.540165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351ece2-14de-4951-9d16-3c78f085215b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:57.556694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a25d6b-6292-4964-b14e-fcfc6b12202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:57.560108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a25d6b-6292-4964-b14e-fcfc6b12202d admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:57.560618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a25d6b-6292-4964-b14e-fcfc6b12202d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:57.562459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a25d6b-6292-4964-b14e-fcfc6b12202d admin admin] PATH_INFO: `/v3/projects/b8b140e10a9346e096f804c4d8f00355/users/d955e566b4ba4fc1ac2377056c1a2fbf/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:57.568774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a25d6b-6292-4964-b14e-fcfc6b12202d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b140e10a9346e096f804c4d8f00355, user_id=d955e566b4ba4fc1ac2377056c1a2fbf, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:57.664335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a25d6b-6292-4964-b14e-fcfc6b12202d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:57.693513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 827/1652] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:57 2021] PUT /identity/v3/projects/b8b140e10a9346e096f804c4d8f00355/users/d955e566b4ba4fc1ac2377056c1a2fbf/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:57.697878 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aacee4-2318-48c9-b026-1e1e4e46a133 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:57.712470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aacee4-2318-48c9-b026-1e1e4e46a133 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:57.851076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1a2c-0555-4201-acc3-d793b7faf906 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:57.851367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1a2c-0555-4201-acc3-d793b7faf906 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:57.851652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1a2c-0555-4201-acc3-d793b7faf906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:57.882481 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7365d-4530-4c83-b696-d11007d772cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:57.883526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7365d-4530-4c83-b696-d11007d772cf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:57.884017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7365d-4530-4c83-b696-d11007d772cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:57.884497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7365d-4530-4c83-b696-d11007d772cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:57.885762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7365d-4530-4c83-b696-d11007d772cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:57.918807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-61ee1a2c-0555-4201-acc3-d793b7faf906 None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:57.925958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-61ee1a2c-0555-4201-acc3-d793b7faf906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:57.943551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7365d-4530-4c83-b696-d11007d772cf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:57.994755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 826/1653] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:37:57 2021] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:37:57.996661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7365d-4530-4c83-b696-d11007d772cf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:58.011435 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7365d-4530-4c83-b696-d11007d772cf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:58.018252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8c616-1259-4c84-856c-00e5a142d130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:58.019412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c616-1259-4c84-856c-00e5a142d130 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:58.019875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c616-1259-4c84-856c-00e5a142d130 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:58.020451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c616-1259-4c84-856c-00e5a142d130 admin admin] PATH_INFO: `/v3/projects/b8b140e10a9346e096f804c4d8f00355/users/d955e566b4ba4fc1ac2377056c1a2fbf/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:58.024402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8c616-1259-4c84-856c-00e5a142d130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b140e10a9346e096f804c4d8f00355, user_id=d955e566b4ba4fc1ac2377056c1a2fbf, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:58.201270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8c616-1259-4c84-856c-00e5a142d130 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:58.219786 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 828/1654] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:37:57 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:37:58.238672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 827/1655] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:37:57 2021] PUT /identity/v3/projects/b8b140e10a9346e096f804c4d8f00355/users/d955e566b4ba4fc1ac2377056c1a2fbf/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:37:58.253573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9192b-7f06-40f8-bff4-fa44d1848a30 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:58.254242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9192b-7f06-40f8-bff4-fa44d1848a30 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:58.254789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9192b-7f06-40f8-bff4-fa44d1848a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:58.412261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-75a9192b-7f06-40f8-bff4-fa44d1848a30 None None] MFA Rules not processed for user `d955e566b4ba4fc1ac2377056c1a2fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:58.418774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-75a9192b-7f06-40f8-bff4-fa44d1848a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:58.483280 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8c616-1259-4c84-856c-00e5a142d130 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:58.486512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-45a8c616-1259-4c84-856c-00e5a142d130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:58.615396 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 829/1656] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:58 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:37:58.620773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9192b-7f06-40f8-bff4-fa44d1848a30 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:58.623531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-75a9192b-7f06-40f8-bff4-fa44d1848a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:58.760331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8c616-1259-4c84-856c-00e5a142d130 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:58.781558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:58.783319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:58.783967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:58.784583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:58.793972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:58.863251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9192b-7f06-40f8-bff4-fa44d1848a30 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:58.873710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ba69-7ac4-4087-bc5b-be0445d28b92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:58.875990 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ba69-7ac4-4087-bc5b-be0445d28b92 service swift] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:58.876841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ba69-7ac4-4087-bc5b-be0445d28b92 service swift] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:58.877558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ba69-7ac4-4087-bc5b-be0445d28b92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:59.062714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:59.114363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:59.139934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 828/1657] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:58 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:37:59.142058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:37:59.146375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:37:59.191900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef98cf-c1ed-480d-a863-34bd02c7ab94 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:37:59.199498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724ba69-7ac4-4087-bc5b-be0445d28b92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:59.207224 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe3c1-18d6-4794-bbab-f63e5e493e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:37:59.214961 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe3c1-18d6-4794-bbab-f63e5e493e79 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:59.216385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe3c1-18d6-4794-bbab-f63e5e493e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:59.218079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe3c1-18d6-4794-bbab-f63e5e493e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:59.263103 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe3c1-18d6-4794-bbab-f63e5e493e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:37:59.309642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724ba69-7ac4-4087-bc5b-be0445d28b92 service swift] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:59.353636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 830/1658] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:37:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:37:59.434634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe3c1-18d6-4794-bbab-f63e5e493e79 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:37:59.487096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 829/1659] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:37:59 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:37:59.612601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11231-e3fb-4019-b49d-ad79c8f1f654 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:37:59.613128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11231-e3fb-4019-b49d-ad79c8f1f654 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:37:59.613516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11231-e3fb-4019-b49d-ad79c8f1f654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:37:59.737143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-bbc11231-e3fb-4019-b49d-ad79c8f1f654 None None] MFA Rules not processed for user `6c6c792676f1498e98f638a268abf1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:37:59.739130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-bbc11231-e3fb-4019-b49d-ad79c8f1f654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:00.055262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 831/1660] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:37:59 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:00.204690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac4d92-d5e6-48a9-a9d6-21ad5e06c832 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:00.205700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac4d92-d5e6-48a9-a9d6-21ad5e06c832 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:00.206577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac4d92-d5e6-48a9-a9d6-21ad5e06c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:00.325131 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-7cac4d92-d5e6-48a9-a9d6-21ad5e06c832 None None] MFA Rules not processed for user `20905ef1afa847bc8f2f6f6e335f8bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:00.327278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7cac4d92-d5e6-48a9-a9d6-21ad5e06c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:00.470673 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5bb08-15aa-496d-b5b3-86211b6472b1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:00.471010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5bb08-15aa-496d-b5b3-86211b6472b1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:00.471407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5bb08-15aa-496d-b5b3-86211b6472b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:00.538110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-21b5bb08-15aa-496d-b5b3-86211b6472b1 None None] MFA Rules not processed for user `0d72966786b641f48edda655d2d0ba45`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:00.539327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-21b5bb08-15aa-496d-b5b3-86211b6472b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:00.540788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 830/1661] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Dec 16 14:38:00 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:00.591911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac4d92-d5e6-48a9-a9d6-21ad5e06c832 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:00.593828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7cac4d92-d5e6-48a9-a9d6-21ad5e06c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:00.625711 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac4d92-d5e6-48a9-a9d6-21ad5e06c832 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:00.665635 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fe9f3-06c4-4706-b19c-757f99c29c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:00.666049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fe9f3-06c4-4706-b19c-757f99c29c26 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:00.666243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fe9f3-06c4-4706-b19c-757f99c29c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:00.666481 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fe9f3-06c4-4706-b19c-757f99c29c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:00.695962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fe9f3-06c4-4706-b19c-757f99c29c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:00.800829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fe9f3-06c4-4706-b19c-757f99c29c26 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:00.840721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 831/1662] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:00 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:00.885591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 832/1663] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:00 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:01.569946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fe9f3-06c4-4706-b19c-757f99c29c26 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:01.754868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2869d24-b515-44f4-90b8-62694bb5eda5 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:01.755176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2869d24-b515-44f4-90b8-62694bb5eda5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:01.755445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2869d24-b515-44f4-90b8-62694bb5eda5 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:01.759007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 833/1664] 10.222.0.67 () {54 vars in 912 bytes} [Thu Dec 16 14:38:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:38:01.779318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fe9f3-06c4-4706-b19c-757f99c29c26 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:01.779967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed42e-5190-4a0a-a6c3-8e6a4a05e163 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:01.780437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed42e-5190-4a0a-a6c3-8e6a4a05e163 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:01.780874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed42e-5190-4a0a-a6c3-8e6a4a05e163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:01.808168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:01.809373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:01.809853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:01.812761 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] PATH_INFO: `/v3/users/074cec530f3b4f6a82f839cee2528010` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:01.815002 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074cec530f3b4f6a82f839cee2528010)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:01.868050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1beed42e-5190-4a0a-a6c3-8e6a4a05e163 None None] MFA Rules not processed for user `20905ef1afa847bc8f2f6f6e335f8bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:01.877692 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1beed42e-5190-4a0a-a6c3-8e6a4a05e163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:01.903306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 834/1665] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Dec 16 14:38:01 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:01.923218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed42e-5190-4a0a-a6c3-8e6a4a05e163 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:01.924941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1beed42e-5190-4a0a-a6c3-8e6a4a05e163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:01.941368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: WARNING py.warnings [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:38:01.941368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: warnings.warn(msg) Dec 16 14:38:01.941368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: Dec 16 14:38:01.943121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed42e-5190-4a0a-a6c3-8e6a4a05e163 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:01.943633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:01.953035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912754f3-bef8-4f13-9ea4-4c5b3d249e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:01.956273 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912754f3-bef8-4f13-9ea4-4c5b3d249e78 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:01.957482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912754f3-bef8-4f13-9ea4-4c5b3d249e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:01.958144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912754f3-bef8-4f13-9ea4-4c5b3d249e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:01.971521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912754f3-bef8-4f13-9ea4-4c5b3d249e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:02.008089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912754f3-bef8-4f13-9ea4-4c5b3d249e78 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:02.022809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 835/1666] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:01 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:02.245379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074cec530f3b4f6a82f839cee2528010'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:02.313662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074cec530f3b4f6a82f839cee2528010'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:02.316971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074cec530f3b4f6a82f839cee2528010'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:02.352237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074cec530f3b4f6a82f839cee2528010'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:02.402445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074cec530f3b4f6a82f839cee2528010'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:02.432888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 832/1667] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:01 2021] DELETE /identity/v3/users/074cec530f3b4f6a82f839cee2528010 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:02.441615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813fcf5-2e62-4eed-bbf6-b2248a46729f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:02.442306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813fcf5-2e62-4eed-bbf6-b2248a46729f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:02.444257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813fcf5-2e62-4eed-bbf6-b2248a46729f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:02.522165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c813fcf5-2e62-4eed-bbf6-b2248a46729f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:02.524605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c813fcf5-2e62-4eed-bbf6-b2248a46729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:02.717178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 836/1668] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:02.885527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:02.885527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:03.031950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b33a6a-1678-4f61-816c-586c861bdd60 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:03.038299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a950ae-d8d4-4890-815e-5e51bb2739ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:03.039582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a950ae-d8d4-4890-815e-5e51bb2739ae service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:03.039986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a950ae-d8d4-4890-815e-5e51bb2739ae service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:03.040629 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a950ae-d8d4-4890-815e-5e51bb2739ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:03.083578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a950ae-d8d4-4890-815e-5e51bb2739ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:03.151123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a950ae-d8d4-4890-815e-5e51bb2739ae service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:03.172602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 833/1669] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:04.173592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df80c88-df10-4b70-b738-c75e198a7bdc None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:04.174339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df80c88-df10-4b70-b738-c75e198a7bdc None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:04.174648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df80c88-df10-4b70-b738-c75e198a7bdc None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:04.178218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 837/1670] 10.222.0.67 () {54 vars in 921 bytes} [Thu Dec 16 14:38:04 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 16 14:38:04.186614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4932d76-d018-4d3d-a74a-2c96c3ad0df4 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:04.190998 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4932d76-d018-4d3d-a74a-2c96c3ad0df4 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:04.191626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4932d76-d018-4d3d-a74a-2c96c3ad0df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:04.352809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b4932d76-d018-4d3d-a74a-2c96c3ad0df4 None None] MFA Rules not processed for user `f2bcc9f013f14ed89f5e94591f170b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:04.360180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b4932d76-d018-4d3d-a74a-2c96c3ad0df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:04.630046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 834/1671] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Dec 16 14:38:04 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:05.097726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df80c88-df10-4b70-b738-c75e198a7bdc None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:05.107740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6df80c88-df10-4b70-b738-c75e198a7bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:05.142992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4932d76-d018-4d3d-a74a-2c96c3ad0df4 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:05.145211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b4932d76-d018-4d3d-a74a-2c96c3ad0df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:05.161397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df80c88-df10-4b70-b738-c75e198a7bdc None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:05.171502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4932d76-d018-4d3d-a74a-2c96c3ad0df4 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:05.173258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:05.174376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:05.175405 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:05.180168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] PATH_INFO: `/v3/projects/9d55ceaabb0443aa964ba5050cf5feff` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:05.183269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d55ceaabb0443aa964ba5050cf5feff)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:05.183724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c190c-d89e-40a2-856d-faec646cb8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:05.184918 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c190c-d89e-40a2-856d-faec646cb8ee service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:05.185478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c190c-d89e-40a2-856d-faec646cb8ee service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:05.186337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c190c-d89e-40a2-856d-faec646cb8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:05.206525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c190c-d89e-40a2-856d-faec646cb8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:05.255494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: WARNING py.warnings [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:38:05.255494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: warnings.warn(msg) Dec 16 14:38:05.255494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: Dec 16 14:38:05.257231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:05.278263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c190c-d89e-40a2-856d-faec646cb8ee service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:05.296533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 835/1672] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:05 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:05.335493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d55ceaabb0443aa964ba5050cf5feff', 'request_id': 'req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.351131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d55ceaabb0443aa964ba5050cf5feff', 'request_id': 'req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.360809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d55ceaabb0443aa964ba5050cf5feff', 'request_id': 'req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.374224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] The token cache is being invalidate because project 9d55ceaabb0443aa964ba5050cf5feff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:05.374510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.375157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.376778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 838/1673] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:05 2021] DELETE /identity/v3/projects/9d55ceaabb0443aa964ba5050cf5feff => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:05.382189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c190c-d89e-40a2-856d-faec646cb8ee service nova] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:05.395110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c190c-d89e-40a2-856d-faec646cb8ee service nova] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:05.534880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:05.536747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:05.538168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:05.538843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] PATH_INFO: `/v3/users/d955e566b4ba4fc1ac2377056c1a2fbf` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:05.541488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d955e566b4ba4fc1ac2377056c1a2fbf)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:05.603064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:05.681645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd955e566b4ba4fc1ac2377056c1a2fbf'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.694963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd955e566b4ba4fc1ac2377056c1a2fbf'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.698586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd955e566b4ba4fc1ac2377056c1a2fbf'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.710582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd955e566b4ba4fc1ac2377056c1a2fbf'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.736925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9aea769c-39fd-43b8-b09c-f264c5b96daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd955e566b4ba4fc1ac2377056c1a2fbf'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:05.746072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 836/1674] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:05 2021] DELETE /identity/v3/users/d955e566b4ba4fc1ac2377056c1a2fbf => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:06.282641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:06.284290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:06.302808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabc94b-39db-4b56-8bdd-e4436e1fb2d7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:06.413659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:06.415959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:06.416590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:06.417532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] PATH_INFO: `/v3/projects/b8b140e10a9346e096f804c4d8f00355` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:06.419031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b140e10a9346e096f804c4d8f00355)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:06.456924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:06.538880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b140e10a9346e096f804c4d8f00355', 'request_id': 'req-58601740-4089-4c68-a576-4a09f71a2076'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:06.554457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b140e10a9346e096f804c4d8f00355', 'request_id': 'req-58601740-4089-4c68-a576-4a09f71a2076'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:06.567504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b140e10a9346e096f804c4d8f00355', 'request_id': 'req-58601740-4089-4c68-a576-4a09f71a2076'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:06.582412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] The token cache is being invalidate because project b8b140e10a9346e096f804c4d8f00355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:06.582748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:06.583513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-58601740-4089-4c68-a576-4a09f71a2076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:06.586231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 839/1675] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:06 2021] DELETE /identity/v3/projects/b8b140e10a9346e096f804c4d8f00355 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:06.592556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9bb4-9074-49b8-860d-fdb24f782e5e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:06.593089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9bb4-9074-49b8-860d-fdb24f782e5e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:06.593089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9bb4-9074-49b8-860d-fdb24f782e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:06.631802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3c5b9bb4-9074-49b8-860d-fdb24f782e5e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:06.633217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3c5b9bb4-9074-49b8-860d-fdb24f782e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:06.715030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 837/1676] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:06.723729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beab14b-20b1-4a6e-a665-5c5fff3c24ef None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:06.724113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beab14b-20b1-4a6e-a665-5c5fff3c24ef None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:06.724453 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beab14b-20b1-4a6e-a665-5c5fff3c24ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:06.748861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1beab14b-20b1-4a6e-a665-5c5fff3c24ef None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:06.750194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1beab14b-20b1-4a6e-a665-5c5fff3c24ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:06.758381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 840/1677] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:06.763814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9bb4-9074-49b8-860d-fdb24f782e5e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:06.775320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9bb4-9074-49b8-860d-fdb24f782e5e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:06.780250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7d6dd-d8b6-4656-b931-e311cf57f985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:06.781321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7d6dd-d8b6-4656-b931-e311cf57f985 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:06.781548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7d6dd-d8b6-4656-b931-e311cf57f985 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:06.781895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7d6dd-d8b6-4656-b931-e311cf57f985 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:06.782702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7d6dd-d8b6-4656-b931-e311cf57f985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:06.783007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7d6dd-d8b6-4656-b931-e311cf57f985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:06.809838 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7d6dd-d8b6-4656-b931-e311cf57f985 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:06.825328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 838/1678] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:38:06.830032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beab14b-20b1-4a6e-a665-5c5fff3c24ef None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:06.841306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beab14b-20b1-4a6e-a665-5c5fff3c24ef None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:06.849610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f71df-cd18-41a4-aeca-d5b9375076c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:06.851522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f71df-cd18-41a4-aeca-d5b9375076c9 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:06.851993 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f71df-cd18-41a4-aeca-d5b9375076c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:06.852430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f71df-cd18-41a4-aeca-d5b9375076c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:06.853530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f71df-cd18-41a4-aeca-d5b9375076c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:06.906902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f71df-cd18-41a4-aeca-d5b9375076c9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:06.962221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 841/1679] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:06 2021] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:06.963332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7d6dd-d8b6-4656-b931-e311cf57f985 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:06.977936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7d6dd-d8b6-4656-b931-e311cf57f985 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:07.075162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e6def-5fe9-494b-a09c-3b3cf5e8713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:07.075857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e6def-5fe9-494b-a09c-3b3cf5e8713e admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:07.076162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e6def-5fe9-494b-a09c-3b3cf5e8713e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:07.079443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e6def-5fe9-494b-a09c-3b3cf5e8713e admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:07.082595 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e6def-5fe9-494b-a09c-3b3cf5e8713e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:07.110628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e6def-5fe9-494b-a09c-3b3cf5e8713e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:07.132733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 839/1680] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:06 2021] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:07.137244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f71df-cd18-41a4-aeca-d5b9375076c9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:07.148601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f71df-cd18-41a4-aeca-d5b9375076c9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:07.153144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87347d7e-3e66-49d6-97d2-ee961fd854c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:07.153771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347d7e-3e66-49d6-97d2-ee961fd854c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:07.154093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347d7e-3e66-49d6-97d2-ee961fd854c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:07.154378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347d7e-3e66-49d6-97d2-ee961fd854c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:07.155135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87347d7e-3e66-49d6-97d2-ee961fd854c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:07.185962 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87347d7e-3e66-49d6-97d2-ee961fd854c1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:07.197713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 842/1681] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:07 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:07.202944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e6def-5fe9-494b-a09c-3b3cf5e8713e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:07.215017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e6def-5fe9-494b-a09c-3b3cf5e8713e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:07.219492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13076c27-d3f9-4849-88c3-a7bb065f4901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:07.220326 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13076c27-d3f9-4849-88c3-a7bb065f4901 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:07.220613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13076c27-d3f9-4849-88c3-a7bb065f4901 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:07.220897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13076c27-d3f9-4849-88c3-a7bb065f4901 admin admin] PATH_INFO: `/v3/projects/00639a8de5fb4d5f95602438bc87866e/users/6d4488d0175e48c9be8f5ab6abb1421a/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:07.243586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13076c27-d3f9-4849-88c3-a7bb065f4901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00639a8de5fb4d5f95602438bc87866e, user_id=6d4488d0175e48c9be8f5ab6abb1421a, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:07.270629 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13076c27-d3f9-4849-88c3-a7bb065f4901 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:07.286465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 840/1682] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:07 2021] PUT /identity/v3/projects/00639a8de5fb4d5f95602438bc87866e/users/6d4488d0175e48c9be8f5ab6abb1421a/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:07.297144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046860cb-c688-48f0-bd96-b5edbaa093a4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:07.297663 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046860cb-c688-48f0-bd96-b5edbaa093a4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:07.297663 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046860cb-c688-48f0-bd96-b5edbaa093a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:07.343337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-046860cb-c688-48f0-bd96-b5edbaa093a4 None None] MFA Rules not processed for user `6d4488d0175e48c9be8f5ab6abb1421a`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:07.344628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-046860cb-c688-48f0-bd96-b5edbaa093a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:07.429741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 843/1683] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:07 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:07.435211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13076c27-d3f9-4849-88c3-a7bb065f4901 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:07.514987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13076c27-d3f9-4849-88c3-a7bb065f4901 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:07.519846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c885eef-9891-4aca-ab7d-a82f4013f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:07.520606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c885eef-9891-4aca-ab7d-a82f4013f596 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:07.520894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c885eef-9891-4aca-ab7d-a82f4013f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:07.521175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c885eef-9891-4aca-ab7d-a82f4013f596 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:07.522516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c885eef-9891-4aca-ab7d-a82f4013f596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:07.557793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c885eef-9891-4aca-ab7d-a82f4013f596 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:07.623243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 841/1684] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:07 2021] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:38:07.627551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046860cb-c688-48f0-bd96-b5edbaa093a4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:07.641038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046860cb-c688-48f0-bd96-b5edbaa093a4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:07.729314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8c28e-9cbc-40b6-9a7b-b75388ecf3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:07.730409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c28e-9cbc-40b6-9a7b-b75388ecf3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:07.730694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c28e-9cbc-40b6-9a7b-b75388ecf3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:07.731146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8c28e-9cbc-40b6-9a7b-b75388ecf3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:07.732056 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8c28e-9cbc-40b6-9a7b-b75388ecf3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:07.766593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8c28e-9cbc-40b6-9a7b-b75388ecf3c3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:07.816200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 844/1685] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:07 2021] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:07.820432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c885eef-9891-4aca-ab7d-a82f4013f596 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:07.841887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c885eef-9891-4aca-ab7d-a82f4013f596 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:07.849488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1a220-55d5-4e7c-b91e-98acb1732060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:07.850233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1a220-55d5-4e7c-b91e-98acb1732060 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:07.850624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1a220-55d5-4e7c-b91e-98acb1732060 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:07.850923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1a220-55d5-4e7c-b91e-98acb1732060 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:07.854614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1a220-55d5-4e7c-b91e-98acb1732060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:07.926485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1a220-55d5-4e7c-b91e-98acb1732060 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:07.956503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 842/1686] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:07 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:07.961208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8c28e-9cbc-40b6-9a7b-b75388ecf3c3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:07.973940 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8c28e-9cbc-40b6-9a7b-b75388ecf3c3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:07.982108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5e4b9-4f1d-4cf1-b596-1a773c377df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:07.982108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5e4b9-4f1d-4cf1-b596-1a773c377df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:07.982108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5e4b9-4f1d-4cf1-b596-1a773c377df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:07.982108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5e4b9-4f1d-4cf1-b596-1a773c377df7 admin admin] PATH_INFO: `/v3/projects/7c0e3c35782f4d758954fe7b9e139693/users/ecf74826f8554987b89ad7e788c3907b/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:08.015305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5e4b9-4f1d-4cf1-b596-1a773c377df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0e3c35782f4d758954fe7b9e139693, user_id=ecf74826f8554987b89ad7e788c3907b, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:08.066940 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5e4b9-4f1d-4cf1-b596-1a773c377df7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:08.095231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 845/1687] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:07 2021] PUT /identity/v3/projects/7c0e3c35782f4d758954fe7b9e139693/users/ecf74826f8554987b89ad7e788c3907b/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:08.099309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1a220-55d5-4e7c-b91e-98acb1732060 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:08.124755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1a220-55d5-4e7c-b91e-98acb1732060 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:08.283831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e645387-d15d-4c3c-97ae-77dfd9e96399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:08.284294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e645387-d15d-4c3c-97ae-77dfd9e96399 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:08.284682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e645387-d15d-4c3c-97ae-77dfd9e96399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:08.285034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e645387-d15d-4c3c-97ae-77dfd9e96399 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:08.285764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e645387-d15d-4c3c-97ae-77dfd9e96399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:08.314465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e645387-d15d-4c3c-97ae-77dfd9e96399 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:08.332557 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 843/1688] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:08 2021] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:08.337367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5e4b9-4f1d-4cf1-b596-1a773c377df7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:08.352770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5e4b9-4f1d-4cf1-b596-1a773c377df7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:08.360783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b636a02-41d8-4a0b-b492-4ecd8eae51bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:08.361882 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b636a02-41d8-4a0b-b492-4ecd8eae51bd admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:08.362374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b636a02-41d8-4a0b-b492-4ecd8eae51bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:08.362807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b636a02-41d8-4a0b-b492-4ecd8eae51bd admin admin] PATH_INFO: `/v3/projects/7c0e3c35782f4d758954fe7b9e139693/users/ecf74826f8554987b89ad7e788c3907b/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:08.365500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b636a02-41d8-4a0b-b492-4ecd8eae51bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0e3c35782f4d758954fe7b9e139693, user_id=ecf74826f8554987b89ad7e788c3907b, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:08.405825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b636a02-41d8-4a0b-b492-4ecd8eae51bd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:08.423394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 846/1689] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:08 2021] PUT /identity/v3/projects/7c0e3c35782f4d758954fe7b9e139693/users/ecf74826f8554987b89ad7e788c3907b/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:08.425476 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e645387-d15d-4c3c-97ae-77dfd9e96399 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:08.459667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e645387-d15d-4c3c-97ae-77dfd9e96399 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:08.539904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08065c8c-6ea9-48c6-ae14-7f7e4e7b39b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:08.540629 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065c8c-6ea9-48c6-ae14-7f7e4e7b39b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:08.540917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065c8c-6ea9-48c6-ae14-7f7e4e7b39b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:08.541202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065c8c-6ea9-48c6-ae14-7f7e4e7b39b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:08.541912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08065c8c-6ea9-48c6-ae14-7f7e4e7b39b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:08.568180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08065c8c-6ea9-48c6-ae14-7f7e4e7b39b4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:08.586819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 844/1690] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:08 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:08.591697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b636a02-41d8-4a0b-b492-4ecd8eae51bd admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:08.626967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b636a02-41d8-4a0b-b492-4ecd8eae51bd admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:08.634969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c77b-38fc-4554-8a23-a5ec830c6a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:08.636120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c77b-38fc-4554-8a23-a5ec830c6a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:08.636474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c77b-38fc-4554-8a23-a5ec830c6a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:08.636756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c77b-38fc-4554-8a23-a5ec830c6a91 admin admin] PATH_INFO: `/v3/projects/7c0e3c35782f4d758954fe7b9e139693/users/ecf74826f8554987b89ad7e788c3907b/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:08.639124 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2c77b-38fc-4554-8a23-a5ec830c6a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0e3c35782f4d758954fe7b9e139693, user_id=ecf74826f8554987b89ad7e788c3907b, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:08.668157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2c77b-38fc-4554-8a23-a5ec830c6a91 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:08.686579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 847/1691] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:08 2021] PUT /identity/v3/projects/7c0e3c35782f4d758954fe7b9e139693/users/ecf74826f8554987b89ad7e788c3907b/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:08.698729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872ed3e-652d-493e-972c-1a9da87cecb7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:08.699269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872ed3e-652d-493e-972c-1a9da87cecb7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:08.699379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872ed3e-652d-493e-972c-1a9da87cecb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:08.741980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-7872ed3e-652d-493e-972c-1a9da87cecb7 None None] MFA Rules not processed for user `ecf74826f8554987b89ad7e788c3907b`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:08.743297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7872ed3e-652d-493e-972c-1a9da87cecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:08.828483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 845/1692] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:08 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:08.838980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c77b-38fc-4554-8a23-a5ec830c6a91 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:08.841496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7bc2c77b-38fc-4554-8a23-a5ec830c6a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:08.913689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c77b-38fc-4554-8a23-a5ec830c6a91 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:08.917624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d96cd9-e2e6-46b5-9b95-f4a9d3011f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:08.918378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96cd9-e2e6-46b5-9b95-f4a9d3011f40 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:08.918721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96cd9-e2e6-46b5-9b95-f4a9d3011f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:08.919027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96cd9-e2e6-46b5-9b95-f4a9d3011f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:08.931585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d96cd9-e2e6-46b5-9b95-f4a9d3011f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:08.961167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d96cd9-e2e6-46b5-9b95-f4a9d3011f40 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:08.972705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 848/1693] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:08 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:11.176153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872ed3e-652d-493e-972c-1a9da87cecb7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:11.271220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872ed3e-652d-493e-972c-1a9da87cecb7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:11.276874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:11.277914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:11.278281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:11.278668 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] PATH_INFO: `/v3/users/6d4488d0175e48c9be8f5ab6abb1421a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:11.280010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4488d0175e48c9be8f5ab6abb1421a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:11.318450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:11.381684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4488d0175e48c9be8f5ab6abb1421a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:11.390723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4488d0175e48c9be8f5ab6abb1421a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:11.391586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4488d0175e48c9be8f5ab6abb1421a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:11.401845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4488d0175e48c9be8f5ab6abb1421a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:11.423606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4488d0175e48c9be8f5ab6abb1421a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:11.435398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 846/1694] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:11 2021] DELETE /identity/v3/users/6d4488d0175e48c9be8f5ab6abb1421a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:11.436854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c9c2f-a9e3-4e88-842a-d8f4fa343666 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:11.437318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c9c2f-a9e3-4e88-842a-d8f4fa343666 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:11.437623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c9c2f-a9e3-4e88-842a-d8f4fa343666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:11.476003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-541c9c2f-a9e3-4e88-842a-d8f4fa343666 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:11.477926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-541c9c2f-a9e3-4e88-842a-d8f4fa343666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:11.579044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 849/1695] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:11.586880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:11.588471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:11.672160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ca57-1d95-4b54-add8-0d8f3321675a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:11.675689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbd384-eb2c-4fcc-b13b-bc11abad23f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:11.676374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbd384-eb2c-4fcc-b13b-bc11abad23f8 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:11.676751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbd384-eb2c-4fcc-b13b-bc11abad23f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:11.677101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbd384-eb2c-4fcc-b13b-bc11abad23f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:11.689578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbd384-eb2c-4fcc-b13b-bc11abad23f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:11.734978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbd384-eb2c-4fcc-b13b-bc11abad23f8 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:11.760778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 847/1696] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:12.339164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c9c2f-a9e3-4e88-842a-d8f4fa343666 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:12.341169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-541c9c2f-a9e3-4e88-842a-d8f4fa343666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:12.354539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c9c2f-a9e3-4e88-842a-d8f4fa343666 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:12.360291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:12.361052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:12.361333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:12.361594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] PATH_INFO: `/v3/projects/00639a8de5fb4d5f95602438bc87866e` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:12.362774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00639a8de5fb4d5f95602438bc87866e)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:12.389054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:12.446433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00639a8de5fb4d5f95602438bc87866e', 'request_id': 'req-00dd778e-1f2c-4e17-99f2-8605cd769747'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.459800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00639a8de5fb4d5f95602438bc87866e', 'request_id': 'req-00dd778e-1f2c-4e17-99f2-8605cd769747'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.469217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00639a8de5fb4d5f95602438bc87866e', 'request_id': 'req-00dd778e-1f2c-4e17-99f2-8605cd769747'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.479744 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] The token cache is being invalidate because project 00639a8de5fb4d5f95602438bc87866e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:12.480023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.480661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.482168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 850/1697] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:12 2021] DELETE /identity/v3/projects/00639a8de5fb4d5f95602438bc87866e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:12.486670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbd384-eb2c-4fcc-b13b-bc11abad23f8 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:12.496970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbd384-eb2c-4fcc-b13b-bc11abad23f8 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:12.567834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:12.568680 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:12.569016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:12.569334 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] PATH_INFO: `/v3/users/ecf74826f8554987b89ad7e788c3907b` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:12.570546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf74826f8554987b89ad7e788c3907b)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:12.596912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:12.649024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf74826f8554987b89ad7e788c3907b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.656923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf74826f8554987b89ad7e788c3907b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.657697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf74826f8554987b89ad7e788c3907b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.667444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf74826f8554987b89ad7e788c3907b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.680736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-96c5b2eb-6ae3-472f-b684-9e89034af59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf74826f8554987b89ad7e788c3907b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:12.687274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 848/1698] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:12 2021] DELETE /identity/v3/users/ecf74826f8554987b89ad7e788c3907b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:13.234117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:13.235787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:13.266194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd778e-1f2c-4e17-99f2-8605cd769747 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:13.358095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:13.359854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:13.360340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:13.368218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] PATH_INFO: `/v3/projects/7c0e3c35782f4d758954fe7b9e139693` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:13.370111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0e3c35782f4d758954fe7b9e139693)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:13.400680 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:13.474389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0e3c35782f4d758954fe7b9e139693', 'request_id': 'req-e56658ff-6344-4ef3-9f75-ea968c79a57c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:13.493434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0e3c35782f4d758954fe7b9e139693', 'request_id': 'req-e56658ff-6344-4ef3-9f75-ea968c79a57c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:13.502787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0e3c35782f4d758954fe7b9e139693', 'request_id': 'req-e56658ff-6344-4ef3-9f75-ea968c79a57c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:13.513873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] The token cache is being invalidate because project 7c0e3c35782f4d758954fe7b9e139693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:13.514198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:13.514857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e56658ff-6344-4ef3-9f75-ea968c79a57c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:13.516484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 851/1699] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:13 2021] DELETE /identity/v3/projects/7c0e3c35782f4d758954fe7b9e139693 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:13.523444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957893-90ea-49d3-af9c-bb30c4dc1473 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:13.524070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957893-90ea-49d3-af9c-bb30c4dc1473 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:13.524070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957893-90ea-49d3-af9c-bb30c4dc1473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:13.554279 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-34957893-90ea-49d3-af9c-bb30c4dc1473 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:13.556713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-34957893-90ea-49d3-af9c-bb30c4dc1473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:13.643000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 849/1700] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:13.651171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92344494-fefb-42b4-be73-736660b7c1b9 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:13.651575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92344494-fefb-42b4-be73-736660b7c1b9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:13.651884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92344494-fefb-42b4-be73-736660b7c1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:13.684349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-92344494-fefb-42b4-be73-736660b7c1b9 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:13.686814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-92344494-fefb-42b4-be73-736660b7c1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:13.701945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 852/1701] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:13.706326 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34957893-90ea-49d3-af9c-bb30c4dc1473 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:13.719777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34957893-90ea-49d3-af9c-bb30c4dc1473 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:13.727362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274ba30-08ce-45fc-90f8-02ffdc097cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:13.728325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274ba30-08ce-45fc-90f8-02ffdc097cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:13.729090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274ba30-08ce-45fc-90f8-02ffdc097cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:13.729578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274ba30-08ce-45fc-90f8-02ffdc097cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:13.730782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274ba30-08ce-45fc-90f8-02ffdc097cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:13.731416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274ba30-08ce-45fc-90f8-02ffdc097cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:13.766461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274ba30-08ce-45fc-90f8-02ffdc097cb4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:13.781768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 850/1702] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:38:13.786459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92344494-fefb-42b4-be73-736660b7c1b9 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:13.797498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92344494-fefb-42b4-be73-736660b7c1b9 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:13.802249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c2fc1-ff8e-484f-bef2-728f23856ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:13.802988 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c2fc1-ff8e-484f-bef2-728f23856ebc admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:13.803509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c2fc1-ff8e-484f-bef2-728f23856ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:13.804350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c2fc1-ff8e-484f-bef2-728f23856ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:13.805081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c2fc1-ff8e-484f-bef2-728f23856ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:13.832684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c2fc1-ff8e-484f-bef2-728f23856ebc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:13.870063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 853/1703] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:13 2021] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:13.874859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274ba30-08ce-45fc-90f8-02ffdc097cb4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:13.886381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274ba30-08ce-45fc-90f8-02ffdc097cb4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:13.967454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44d7b0-a279-4693-814b-9f8b3e9de169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:13.968298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44d7b0-a279-4693-814b-9f8b3e9de169 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:13.968657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44d7b0-a279-4693-814b-9f8b3e9de169 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:13.969086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44d7b0-a279-4693-814b-9f8b3e9de169 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:13.969965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44d7b0-a279-4693-814b-9f8b3e9de169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:13.997646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44d7b0-a279-4693-814b-9f8b3e9de169 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:14.052713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c2fc1-ff8e-484f-bef2-728f23856ebc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:14.053312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 851/1704] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:13 2021] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:38:14.067123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c2fc1-ff8e-484f-bef2-728f23856ebc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:14.075879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e607ce-c3fb-4879-8370-8fae13dbda4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:14.076597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e607ce-c3fb-4879-8370-8fae13dbda4c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:14.076949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e607ce-c3fb-4879-8370-8fae13dbda4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:14.077229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e607ce-c3fb-4879-8370-8fae13dbda4c admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:14.078088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e607ce-c3fb-4879-8370-8fae13dbda4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:14.158543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e607ce-c3fb-4879-8370-8fae13dbda4c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:14.177606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 854/1705] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:38:14.178913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44d7b0-a279-4693-814b-9f8b3e9de169 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:14.191247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44d7b0-a279-4693-814b-9f8b3e9de169 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:14.216270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b31c44-d3a2-4c8b-b5eb-67d5be5cc338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:14.219128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b31c44-d3a2-4c8b-b5eb-67d5be5cc338 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:14.219520 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b31c44-d3a2-4c8b-b5eb-67d5be5cc338 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:14.219916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b31c44-d3a2-4c8b-b5eb-67d5be5cc338 admin admin] PATH_INFO: `/v3/projects/b0f6aa28e1264e88bc69114e2c780c9c/users/f5e43d009bbb42d88f62a0ccdbafa999/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:14.248347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b31c44-d3a2-4c8b-b5eb-67d5be5cc338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f6aa28e1264e88bc69114e2c780c9c, user_id=f5e43d009bbb42d88f62a0ccdbafa999, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:14.283930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b31c44-d3a2-4c8b-b5eb-67d5be5cc338 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:14.318649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 852/1706] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:14 2021] PUT /identity/v3/projects/b0f6aa28e1264e88bc69114e2c780c9c/users/f5e43d009bbb42d88f62a0ccdbafa999/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:14.326064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a06be-00d5-4351-b6e1-808074ee15de None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:14.326064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a06be-00d5-4351-b6e1-808074ee15de None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:14.326064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a06be-00d5-4351-b6e1-808074ee15de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:14.370480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5e4a06be-00d5-4351-b6e1-808074ee15de None None] MFA Rules not processed for user `f5e43d009bbb42d88f62a0ccdbafa999`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:14.371796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5e4a06be-00d5-4351-b6e1-808074ee15de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:14.502749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 855/1707] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:14 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:14.510080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b31c44-d3a2-4c8b-b5eb-67d5be5cc338 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:14.686181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b31c44-d3a2-4c8b-b5eb-67d5be5cc338 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:14.705525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ae79d-69ce-477d-976a-fb66017d84f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:14.706250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ae79d-69ce-477d-976a-fb66017d84f1 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:14.706601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ae79d-69ce-477d-976a-fb66017d84f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:14.706904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ae79d-69ce-477d-976a-fb66017d84f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:14.707605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ae79d-69ce-477d-976a-fb66017d84f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:14.752942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ae79d-69ce-477d-976a-fb66017d84f1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:14.801700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 853/1708] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:14 2021] POST /identity/v3/projects => generated 367 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:14.808997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a06be-00d5-4351-b6e1-808074ee15de None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:14.848366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a06be-00d5-4351-b6e1-808074ee15de None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:15.035727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f1d1-019a-4858-b59c-237ba44c09e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:15.036690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f1d1-019a-4858-b59c-237ba44c09e9 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:15.036978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f1d1-019a-4858-b59c-237ba44c09e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:15.039437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f1d1-019a-4858-b59c-237ba44c09e9 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:15.040194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4f1d1-019a-4858-b59c-237ba44c09e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:15.106059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4f1d1-019a-4858-b59c-237ba44c09e9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:15.181570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 856/1709] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:14 2021] POST /identity/v3/users => generated 290 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:15.183005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ae79d-69ce-477d-976a-fb66017d84f1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:15.209373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ae79d-69ce-477d-976a-fb66017d84f1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:15.227751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a9a3-51c8-4339-9da0-db58278366d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:15.228429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a9a3-51c8-4339-9da0-db58278366d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:15.228768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a9a3-51c8-4339-9da0-db58278366d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:15.229056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a9a3-51c8-4339-9da0-db58278366d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:15.229844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240a9a3-51c8-4339-9da0-db58278366d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:15.267873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240a9a3-51c8-4339-9da0-db58278366d6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:15.298607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 854/1710] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:38:15.300179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f1d1-019a-4858-b59c-237ba44c09e9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:15.322932 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f1d1-019a-4858-b59c-237ba44c09e9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:15.331421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b16d-17b5-4f19-a4a0-6e5dfe5c9d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:15.334169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b16d-17b5-4f19-a4a0-6e5dfe5c9d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:15.334999 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b16d-17b5-4f19-a4a0-6e5dfe5c9d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:15.339737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b16d-17b5-4f19-a4a0-6e5dfe5c9d9b admin admin] PATH_INFO: `/v3/projects/cae85cdc9f7846b48960629087a400d4/users/d1abf17ed4ec449d98d76ce197075ba6/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:15.372403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b16d-17b5-4f19-a4a0-6e5dfe5c9d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae85cdc9f7846b48960629087a400d4, user_id=d1abf17ed4ec449d98d76ce197075ba6, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:15.403796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b16d-17b5-4f19-a4a0-6e5dfe5c9d9b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:15.445335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 857/1711] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:15 2021] PUT /identity/v3/projects/cae85cdc9f7846b48960629087a400d4/users/d1abf17ed4ec449d98d76ce197075ba6/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:15.452053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a9a3-51c8-4339-9da0-db58278366d6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:15.476399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a9a3-51c8-4339-9da0-db58278366d6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:15.622166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb762-6cba-4db8-b9a4-01c5af5f1e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:15.623014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb762-6cba-4db8-b9a4-01c5af5f1e98 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:15.623304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb762-6cba-4db8-b9a4-01c5af5f1e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:15.623582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb762-6cba-4db8-b9a4-01c5af5f1e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:15.624327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bb762-6cba-4db8-b9a4-01c5af5f1e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:15.651096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bb762-6cba-4db8-b9a4-01c5af5f1e98 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:15.678895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 855/1712] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:15.682187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b16d-17b5-4f19-a4a0-6e5dfe5c9d9b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:15.698446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b16d-17b5-4f19-a4a0-6e5dfe5c9d9b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:15.705978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa10fc-ee70-4d0d-8719-24c78bd6ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:15.707658 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa10fc-ee70-4d0d-8719-24c78bd6ad2b admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:15.708362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa10fc-ee70-4d0d-8719-24c78bd6ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:15.709038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa10fc-ee70-4d0d-8719-24c78bd6ad2b admin admin] PATH_INFO: `/v3/projects/cae85cdc9f7846b48960629087a400d4/users/d1abf17ed4ec449d98d76ce197075ba6/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:15.726993 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa10fc-ee70-4d0d-8719-24c78bd6ad2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae85cdc9f7846b48960629087a400d4, user_id=d1abf17ed4ec449d98d76ce197075ba6, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:15.786453 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa10fc-ee70-4d0d-8719-24c78bd6ad2b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:15.800100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 858/1713] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:15 2021] PUT /identity/v3/projects/cae85cdc9f7846b48960629087a400d4/users/d1abf17ed4ec449d98d76ce197075ba6/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:15.804860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb762-6cba-4db8-b9a4-01c5af5f1e98 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:15.823443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb762-6cba-4db8-b9a4-01c5af5f1e98 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:15.854075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa10fc-ee70-4d0d-8719-24c78bd6ad2b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:15.855687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-71aa10fc-ee70-4d0d-8719-24c78bd6ad2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:15.952601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f512d-3e4a-422d-981d-3ed7a8103e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:15.953332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f512d-3e4a-422d-981d-3ed7a8103e11 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:15.953706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f512d-3e4a-422d-981d-3ed7a8103e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:15.954211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f512d-3e4a-422d-981d-3ed7a8103e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:15.954978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f512d-3e4a-422d-981d-3ed7a8103e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:15.993656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa10fc-ee70-4d0d-8719-24c78bd6ad2b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:15.996197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f512d-3e4a-422d-981d-3ed7a8103e11 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:16.008072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:16.009304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:16.009705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:16.010085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] PATH_INFO: `/v3/users/49cacc1c6e6d4593833f57ee62ac8cf6` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:16.012268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 856/1714] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:16.012779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49cacc1c6e6d4593833f57ee62ac8cf6)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:16.013491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f512d-3e4a-422d-981d-3ed7a8103e11 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:16.031207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f512d-3e4a-422d-981d-3ed7a8103e11 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:16.035701 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d0cbd-b176-4c67-bd65-f49b69b9d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:16.036677 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d0cbd-b176-4c67-bd65-f49b69b9d7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:16.036975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d0cbd-b176-4c67-bd65-f49b69b9d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:16.037325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d0cbd-b176-4c67-bd65-f49b69b9d7ac admin admin] PATH_INFO: `/v3/projects/cae85cdc9f7846b48960629087a400d4/users/d1abf17ed4ec449d98d76ce197075ba6/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:16.039719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d0cbd-b176-4c67-bd65-f49b69b9d7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae85cdc9f7846b48960629087a400d4, user_id=d1abf17ed4ec449d98d76ce197075ba6, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:16.069094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d0cbd-b176-4c67-bd65-f49b69b9d7ac admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:16.076869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:16.114675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 857/1715] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:16 2021] PUT /identity/v3/projects/cae85cdc9f7846b48960629087a400d4/users/d1abf17ed4ec449d98d76ce197075ba6/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:16.128631 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653272-7315-4a55-ac0e-b91e752c6303 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:16.129098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653272-7315-4a55-ac0e-b91e752c6303 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:16.129555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653272-7315-4a55-ac0e-b91e752c6303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:16.187965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49cacc1c6e6d4593833f57ee62ac8cf6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:16.231831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49cacc1c6e6d4593833f57ee62ac8cf6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:16.290628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49cacc1c6e6d4593833f57ee62ac8cf6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:16.290628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49cacc1c6e6d4593833f57ee62ac8cf6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:16.338067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-f2da5a44-b114-4739-8628-3fa575e9c687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49cacc1c6e6d4593833f57ee62ac8cf6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:16.343946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 859/1716] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:15 2021] DELETE /identity/v3/users/49cacc1c6e6d4593833f57ee62ac8cf6 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:16.346119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b3653272-7315-4a55-ac0e-b91e752c6303 None None] MFA Rules not processed for user `d1abf17ed4ec449d98d76ce197075ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:16.349832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b3653272-7315-4a55-ac0e-b91e752c6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:16.363030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb4e80-f4e3-4028-bc81-bbcd0603cc31 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:16.369628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb4e80-f4e3-4028-bc81-bbcd0603cc31 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:16.370788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb4e80-f4e3-4028-bc81-bbcd0603cc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:16.481764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-cfeb4e80-f4e3-4028-bc81-bbcd0603cc31 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:16.484705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-cfeb4e80-f4e3-4028-bc81-bbcd0603cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:16.606188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 858/1717] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:16 2021] POST /identity/v3/auth/tokens => generated 3741 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:16.617983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653272-7315-4a55-ac0e-b91e752c6303 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:16.619648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b3653272-7315-4a55-ac0e-b91e752c6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:16.672343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 860/1718] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:16.714460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb4e80-f4e3-4028-bc81-bbcd0603cc31 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:16.716231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-cfeb4e80-f4e3-4028-bc81-bbcd0603cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:16.737378 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653272-7315-4a55-ac0e-b91e752c6303 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:16.742504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f8b70-5777-4158-af48-c129776270e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:16.743243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f8b70-5777-4158-af48-c129776270e3 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:16.743634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f8b70-5777-4158-af48-c129776270e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:16.744156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f8b70-5777-4158-af48-c129776270e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:16.771217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f8b70-5777-4158-af48-c129776270e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:16.804045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f8b70-5777-4158-af48-c129776270e3 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:16.843300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 859/1719] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:16 2021] GET /identity/v3/auth/tokens => generated 3741 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:16.858484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb4e80-f4e3-4028-bc81-bbcd0603cc31 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:16.862427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651823d-d803-4395-9008-95898f44ca83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:16.863212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651823d-d803-4395-9008-95898f44ca83 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:16.863502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651823d-d803-4395-9008-95898f44ca83 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:16.863769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651823d-d803-4395-9008-95898f44ca83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:16.875163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651823d-d803-4395-9008-95898f44ca83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:16.901798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651823d-d803-4395-9008-95898f44ca83 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:16.912702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 861/1720] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:38:16.915104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f8b70-5777-4158-af48-c129776270e3 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:16.916604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1b1f8b70-5777-4158-af48-c129776270e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:16.927789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f8b70-5777-4158-af48-c129776270e3 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:16.931836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9206940-708c-45e6-9393-38718c1a04e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:16.932428 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9206940-708c-45e6-9393-38718c1a04e0 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:16.932703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9206940-708c-45e6-9393-38718c1a04e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:16.932980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9206940-708c-45e6-9393-38718c1a04e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:16.934845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e9206940-708c-45e6-9393-38718c1a04e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:17.037894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9206940-708c-45e6-9393-38718c1a04e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:17.072788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9206940-708c-45e6-9393-38718c1a04e0 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:17.088715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 860/1721] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:16 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:17.454114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651823d-d803-4395-9008-95898f44ca83 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:17.456034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a651823d-d803-4395-9008-95898f44ca83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:17.481850 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651823d-d803-4395-9008-95898f44ca83 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:17.486802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:17.489007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:17.489007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:17.489007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] PATH_INFO: `/v3/projects/01711b77f7c44e5ea58e99d5d3579417` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:17.489292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=01711b77f7c44e5ea58e99d5d3579417)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:17.517434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:17.582561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01711b77f7c44e5ea58e99d5d3579417', 'request_id': 'req-1a834177-2bbc-4034-856a-07fc10b2e3fa'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:17.596512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01711b77f7c44e5ea58e99d5d3579417', 'request_id': 'req-1a834177-2bbc-4034-856a-07fc10b2e3fa'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:17.606268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01711b77f7c44e5ea58e99d5d3579417', 'request_id': 'req-1a834177-2bbc-4034-856a-07fc10b2e3fa'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:17.618657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] The token cache is being invalidate because project 01711b77f7c44e5ea58e99d5d3579417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:17.618955 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:17.619747 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1a834177-2bbc-4034-856a-07fc10b2e3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:17.621307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 862/1722] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:17 2021] DELETE /identity/v3/projects/01711b77f7c44e5ea58e99d5d3579417 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:17.627528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0d88-06a2-4eb9-b88e-da1eb5355bd8 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:17.627902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0d88-06a2-4eb9-b88e-da1eb5355bd8 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:17.628305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0d88-06a2-4eb9-b88e-da1eb5355bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:17.659776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-272b0d88-06a2-4eb9-b88e-da1eb5355bd8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:17.661561 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-272b0d88-06a2-4eb9-b88e-da1eb5355bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:17.770194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 861/1723] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:17.778736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52439-146b-477d-a8e8-8f3df223aaf3 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:17.779285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52439-146b-477d-a8e8-8f3df223aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:17.779285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52439-146b-477d-a8e8-8f3df223aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:17.806354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-9fa52439-146b-477d-a8e8-8f3df223aaf3 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:17.807570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9fa52439-146b-477d-a8e8-8f3df223aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:17.815635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 863/1724] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:17.820213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b0d88-06a2-4eb9-b88e-da1eb5355bd8 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:17.835088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b0d88-06a2-4eb9-b88e-da1eb5355bd8 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:17.842633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7ab6-28de-42da-be15-ff70150e78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:17.843392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7ab6-28de-42da-be15-ff70150e78c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:17.843970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7ab6-28de-42da-be15-ff70150e78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:17.843970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b7ab6-28de-42da-be15-ff70150e78c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:17.844957 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7ab6-28de-42da-be15-ff70150e78c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:17.845363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7ab6-28de-42da-be15-ff70150e78c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:17.874493 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b7ab6-28de-42da-be15-ff70150e78c0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:17.891175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 862/1725] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:38:17.895606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa52439-146b-477d-a8e8-8f3df223aaf3 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:17.905445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa52439-146b-477d-a8e8-8f3df223aaf3 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:17.910765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd52a36-3b62-4a4e-aa09-1c86e43212d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:17.911765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd52a36-3b62-4a4e-aa09-1c86e43212d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:17.912251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd52a36-3b62-4a4e-aa09-1c86e43212d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:17.912737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd52a36-3b62-4a4e-aa09-1c86e43212d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:17.914050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd52a36-3b62-4a4e-aa09-1c86e43212d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:17.945170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd52a36-3b62-4a4e-aa09-1c86e43212d4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:17.992086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 864/1726] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:17 2021] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:17.993299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7ab6-28de-42da-be15-ff70150e78c0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:18.005854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b7ab6-28de-42da-be15-ff70150e78c0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:18.085475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e533d7b-c19f-41a9-b93e-4a0284e6fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:18.086346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e533d7b-c19f-41a9-b93e-4a0284e6fc67 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:18.086688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e533d7b-c19f-41a9-b93e-4a0284e6fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:18.086975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e533d7b-c19f-41a9-b93e-4a0284e6fc67 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:18.088465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e533d7b-c19f-41a9-b93e-4a0284e6fc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:18.128407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e533d7b-c19f-41a9-b93e-4a0284e6fc67 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:18.152755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 863/1727] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:17 2021] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:38:18.157026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd52a36-3b62-4a4e-aa09-1c86e43212d4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:18.167872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd52a36-3b62-4a4e-aa09-1c86e43212d4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:18.173293 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cb15d-84ee-40b1-950c-10155b6d7bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:18.174227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb15d-84ee-40b1-950c-10155b6d7bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:18.174227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb15d-84ee-40b1-950c-10155b6d7bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:18.174649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb15d-84ee-40b1-950c-10155b6d7bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:18.175307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cb15d-84ee-40b1-950c-10155b6d7bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:18.202372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cb15d-84ee-40b1-950c-10155b6d7bc5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:18.219430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e533d7b-c19f-41a9-b93e-4a0284e6fc67 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:18.230384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e533d7b-c19f-41a9-b93e-4a0284e6fc67 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:18.231041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 865/1728] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:18 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:38:18.235158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f905d-c243-4b99-96e2-5c78c6bf508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:18.236029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f905d-c243-4b99-96e2-5c78c6bf508b admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:18.236317 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f905d-c243-4b99-96e2-5c78c6bf508b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:18.236601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f905d-c243-4b99-96e2-5c78c6bf508b admin admin] PATH_INFO: `/v3/projects/69cb559fb5c144ea81394d5566d03237/users/93d7adb3d12a4999a599eeb60d9bb5fe/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:18.261527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f905d-c243-4b99-96e2-5c78c6bf508b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cb559fb5c144ea81394d5566d03237, user_id=93d7adb3d12a4999a599eeb60d9bb5fe, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:18.290706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f905d-c243-4b99-96e2-5c78c6bf508b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:18.306157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 864/1729] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:18 2021] PUT /identity/v3/projects/69cb559fb5c144ea81394d5566d03237/users/93d7adb3d12a4999a599eeb60d9bb5fe/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:18.367750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9f460-60cd-491a-ae21-afe23353b606 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:18.367750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9f460-60cd-491a-ae21-afe23353b606 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:18.367750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9f460-60cd-491a-ae21-afe23353b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:18.418635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-eac9f460-60cd-491a-ae21-afe23353b606 None None] MFA Rules not processed for user `93d7adb3d12a4999a599eeb60d9bb5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:18.418635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-eac9f460-60cd-491a-ae21-afe23353b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:18.509726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 866/1730] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:18 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:18.523149 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f905d-c243-4b99-96e2-5c78c6bf508b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:18.524917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b70f905d-c243-4b99-96e2-5c78c6bf508b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:18.628632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f905d-c243-4b99-96e2-5c78c6bf508b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:18.635280 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c48fe-06bc-4f4c-84ca-28b0cc099875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:18.635999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c48fe-06bc-4f4c-84ca-28b0cc099875 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:18.636381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c48fe-06bc-4f4c-84ca-28b0cc099875 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:18.636731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c48fe-06bc-4f4c-84ca-28b0cc099875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:18.647205 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c48fe-06bc-4f4c-84ca-28b0cc099875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:18.676901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c48fe-06bc-4f4c-84ca-28b0cc099875 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:18.687038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 865/1731] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:18 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:19.404380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9f460-60cd-491a-ae21-afe23353b606 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:19.405856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-eac9f460-60cd-491a-ae21-afe23353b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:19.529402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9f460-60cd-491a-ae21-afe23353b606 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:19.537503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:19.538580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:19.538834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:19.539120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] PATH_INFO: `/v3/users/f5e43d009bbb42d88f62a0ccdbafa999` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:19.540333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e43d009bbb42d88f62a0ccdbafa999)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:19.568087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:19.628737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e43d009bbb42d88f62a0ccdbafa999'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:19.640616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e43d009bbb42d88f62a0ccdbafa999'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:19.648169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e43d009bbb42d88f62a0ccdbafa999'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:19.648882 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e43d009bbb42d88f62a0ccdbafa999'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:19.656773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e43d009bbb42d88f62a0ccdbafa999'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:19.663752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 867/1732] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:19 2021] DELETE /identity/v3/users/f5e43d009bbb42d88f62a0ccdbafa999 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:19.668848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75e9c5-cff2-4be4-a83f-b7b25439dd32 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:19.669382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75e9c5-cff2-4be4-a83f-b7b25439dd32 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:19.669662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75e9c5-cff2-4be4-a83f-b7b25439dd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:19.692775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-5c75e9c5-cff2-4be4-a83f-b7b25439dd32 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:19.694092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5c75e9c5-cff2-4be4-a83f-b7b25439dd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:19.763343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 866/1733] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:19.774474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:19.777035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:19.844202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d8eb-6cc7-4db4-bbf0-88fa8e683f02 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:19.848411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a5e01-af36-4595-a6ac-590c190a3188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:19.849078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5e01-af36-4595-a6ac-590c190a3188 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:19.849303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5e01-af36-4595-a6ac-590c190a3188 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:19.849580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a5e01-af36-4595-a6ac-590c190a3188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:19.859936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a5e01-af36-4595-a6ac-590c190a3188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:19.885572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a5e01-af36-4595-a6ac-590c190a3188 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:19.895967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 868/1734] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:20.406819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75e9c5-cff2-4be4-a83f-b7b25439dd32 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:20.408897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5c75e9c5-cff2-4be4-a83f-b7b25439dd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:20.423867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75e9c5-cff2-4be4-a83f-b7b25439dd32 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:20.431579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:20.432306 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:20.432756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:20.433180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] PATH_INFO: `/v3/projects/b0f6aa28e1264e88bc69114e2c780c9c` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:20.434702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f6aa28e1264e88bc69114e2c780c9c)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:20.467551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:20.556416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f6aa28e1264e88bc69114e2c780c9c', 'request_id': 'req-11c61160-02ad-4142-9d1f-3f222abbfde8'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.577856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f6aa28e1264e88bc69114e2c780c9c', 'request_id': 'req-11c61160-02ad-4142-9d1f-3f222abbfde8'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.589044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f6aa28e1264e88bc69114e2c780c9c', 'request_id': 'req-11c61160-02ad-4142-9d1f-3f222abbfde8'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.614233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] The token cache is being invalidate because project b0f6aa28e1264e88bc69114e2c780c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:20.614233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.615289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.618479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 867/1735] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:20 2021] DELETE /identity/v3/projects/b0f6aa28e1264e88bc69114e2c780c9c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:20.623896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a5e01-af36-4595-a6ac-590c190a3188 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:20.641403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a5e01-af36-4595-a6ac-590c190a3188 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:20.728863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:20.730297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:20.730767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:20.731222 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] PATH_INFO: `/v3/users/d1abf17ed4ec449d98d76ce197075ba6` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:20.733002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1abf17ed4ec449d98d76ce197075ba6)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:20.760959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:20.848980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1abf17ed4ec449d98d76ce197075ba6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.866636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1abf17ed4ec449d98d76ce197075ba6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.880224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1abf17ed4ec449d98d76ce197075ba6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.881212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1abf17ed4ec449d98d76ce197075ba6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.892597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-79a121f6-c787-4c15-afe0-354c3cc10b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1abf17ed4ec449d98d76ce197075ba6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:20.902208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 869/1736] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:20 2021] DELETE /identity/v3/users/d1abf17ed4ec449d98d76ce197075ba6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:21.458497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:21.460836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:21.486770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c61160-02ad-4142-9d1f-3f222abbfde8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:21.573397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:21.574249 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:21.574664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:21.574952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] PATH_INFO: `/v3/projects/cae85cdc9f7846b48960629087a400d4` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:21.576199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae85cdc9f7846b48960629087a400d4)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:21.606904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:21.668859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae85cdc9f7846b48960629087a400d4', 'request_id': 'req-a3e21404-0497-49b1-bebe-b91c56003e96'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:21.686840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae85cdc9f7846b48960629087a400d4', 'request_id': 'req-a3e21404-0497-49b1-bebe-b91c56003e96'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:21.699001 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae85cdc9f7846b48960629087a400d4', 'request_id': 'req-a3e21404-0497-49b1-bebe-b91c56003e96'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:21.717881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] The token cache is being invalidate because project cae85cdc9f7846b48960629087a400d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:21.718342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:21.719408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a3e21404-0497-49b1-bebe-b91c56003e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:21.721729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 868/1737] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:21 2021] DELETE /identity/v3/projects/cae85cdc9f7846b48960629087a400d4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:21.728339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86095-3bfd-4ce8-b574-7354d23c019c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:21.729145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86095-3bfd-4ce8-b574-7354d23c019c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:21.729145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86095-3bfd-4ce8-b574-7354d23c019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:21.797165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-13d86095-3bfd-4ce8-b574-7354d23c019c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:21.798927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-13d86095-3bfd-4ce8-b574-7354d23c019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:21.956568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 870/1738] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:21.957895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581961d6-b943-4683-86c0-3d2b10796587 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:21.958333 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581961d6-b943-4683-86c0-3d2b10796587 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:21.958726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581961d6-b943-4683-86c0-3d2b10796587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:22.005297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-581961d6-b943-4683-86c0-3d2b10796587 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:22.006732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-581961d6-b943-4683-86c0-3d2b10796587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:22.015382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 869/1739] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:22.020249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86095-3bfd-4ce8-b574-7354d23c019c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:22.033019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86095-3bfd-4ce8-b574-7354d23c019c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:22.037938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef05591-2555-44a0-bd3c-f27bcbc8c245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:22.039420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05591-2555-44a0-bd3c-f27bcbc8c245 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:22.039803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05591-2555-44a0-bd3c-f27bcbc8c245 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:22.040145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05591-2555-44a0-bd3c-f27bcbc8c245 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:22.041110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef05591-2555-44a0-bd3c-f27bcbc8c245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:22.041427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef05591-2555-44a0-bd3c-f27bcbc8c245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:22.070605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef05591-2555-44a0-bd3c-f27bcbc8c245 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:22.087820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 871/1740] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:38:22.093045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581961d6-b943-4683-86c0-3d2b10796587 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:22.107072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581961d6-b943-4683-86c0-3d2b10796587 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:22.119655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbfa62-acf7-4af1-83f9-7c9f9a57cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:22.120753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbfa62-acf7-4af1-83f9-7c9f9a57cebf admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:22.121251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbfa62-acf7-4af1-83f9-7c9f9a57cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:22.121682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbfa62-acf7-4af1-83f9-7c9f9a57cebf admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:22.122503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbfa62-acf7-4af1-83f9-7c9f9a57cebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:22.162468 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbfa62-acf7-4af1-83f9-7c9f9a57cebf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:22.215411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 870/1741] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:22 2021] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:22.220005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef05591-2555-44a0-bd3c-f27bcbc8c245 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:22.235237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef05591-2555-44a0-bd3c-f27bcbc8c245 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:22.324318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996a64-8999-4aae-a2bb-2c34205d9acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:22.338352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996a64-8999-4aae-a2bb-2c34205d9acc admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:22.338842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996a64-8999-4aae-a2bb-2c34205d9acc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:22.339131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996a64-8999-4aae-a2bb-2c34205d9acc admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:22.341945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2996a64-8999-4aae-a2bb-2c34205d9acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:22.388013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2996a64-8999-4aae-a2bb-2c34205d9acc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:22.437690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 872/1742] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:22 2021] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:22.441368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbfa62-acf7-4af1-83f9-7c9f9a57cebf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:22.461575 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbfa62-acf7-4af1-83f9-7c9f9a57cebf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:22.469619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb25608-1f29-4dca-a5c7-2fd8f0021247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:22.470930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb25608-1f29-4dca-a5c7-2fd8f0021247 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:22.471444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb25608-1f29-4dca-a5c7-2fd8f0021247 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:22.471900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb25608-1f29-4dca-a5c7-2fd8f0021247 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:22.472871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb25608-1f29-4dca-a5c7-2fd8f0021247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:22.530402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb25608-1f29-4dca-a5c7-2fd8f0021247 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:22.543800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 871/1743] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:22 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:22.548375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996a64-8999-4aae-a2bb-2c34205d9acc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:22.560030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996a64-8999-4aae-a2bb-2c34205d9acc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:22.565966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae84a5e-755c-420b-93b5-8c932a55cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:22.567872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae84a5e-755c-420b-93b5-8c932a55cee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:22.568439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae84a5e-755c-420b-93b5-8c932a55cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:22.568958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae84a5e-755c-420b-93b5-8c932a55cee9 admin admin] PATH_INFO: `/v3/projects/6dfb7fa8a2be4e5b87aabde6afbdb510/users/e64b24d3646d41c298f13280be90fbe5/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:22.594534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae84a5e-755c-420b-93b5-8c932a55cee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dfb7fa8a2be4e5b87aabde6afbdb510, user_id=e64b24d3646d41c298f13280be90fbe5, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:22.625194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae84a5e-755c-420b-93b5-8c932a55cee9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:22.653535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 873/1744] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:22 2021] PUT /identity/v3/projects/6dfb7fa8a2be4e5b87aabde6afbdb510/users/e64b24d3646d41c298f13280be90fbe5/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:22.658429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4a68-9159-4f24-a8d5-7e5915ed0aed None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:22.659765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4a68-9159-4f24-a8d5-7e5915ed0aed None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:22.660282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d4a68-9159-4f24-a8d5-7e5915ed0aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:22.744976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-de2d4a68-9159-4f24-a8d5-7e5915ed0aed None None] MFA Rules not processed for user `e64b24d3646d41c298f13280be90fbe5`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:22.746800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-de2d4a68-9159-4f24-a8d5-7e5915ed0aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:22.856886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae84a5e-755c-420b-93b5-8c932a55cee9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:22.860187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 872/1745] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:22 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:23.004270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae84a5e-755c-420b-93b5-8c932a55cee9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:23.011348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c114fa-5cb1-494a-affc-303b6de4b096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:23.012340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c114fa-5cb1-494a-affc-303b6de4b096 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:23.014697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c114fa-5cb1-494a-affc-303b6de4b096 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:23.015319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c114fa-5cb1-494a-affc-303b6de4b096 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:23.016247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c114fa-5cb1-494a-affc-303b6de4b096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:23.082652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c114fa-5cb1-494a-affc-303b6de4b096 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:23.125384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d4a68-9159-4f24-a8d5-7e5915ed0aed None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:23.137051 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 874/1746] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:22 2021] POST /identity/v3/projects => generated 393 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:23.140182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d4a68-9159-4f24-a8d5-7e5915ed0aed None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:23.331076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69467efd-6c1e-4d3f-8455-927f10a90204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:23.331724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69467efd-6c1e-4d3f-8455-927f10a90204 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:23.332008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69467efd-6c1e-4d3f-8455-927f10a90204 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:23.332290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69467efd-6c1e-4d3f-8455-927f10a90204 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:23.332945 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69467efd-6c1e-4d3f-8455-927f10a90204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:23.376208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69467efd-6c1e-4d3f-8455-927f10a90204 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:23.437185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 873/1747] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:23 2021] POST /identity/v3/users => generated 303 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:23.439760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c114fa-5cb1-494a-affc-303b6de4b096 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:23.459029 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c114fa-5cb1-494a-affc-303b6de4b096 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:23.470764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56e5f6-533b-45a0-9f86-c5bb52f39536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:23.471846 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56e5f6-533b-45a0-9f86-c5bb52f39536 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:23.472334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56e5f6-533b-45a0-9f86-c5bb52f39536 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:23.472820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56e5f6-533b-45a0-9f86-c5bb52f39536 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:23.474834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56e5f6-533b-45a0-9f86-c5bb52f39536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:23.556390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56e5f6-533b-45a0-9f86-c5bb52f39536 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:23.605271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 875/1748] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:23 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:23.610176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69467efd-6c1e-4d3f-8455-927f10a90204 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:23.648946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69467efd-6c1e-4d3f-8455-927f10a90204 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:23.661531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a8a2-8614-40a5-94dc-3fc69d5a455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:23.662423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a8a2-8614-40a5-94dc-3fc69d5a455d admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:23.662710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a8a2-8614-40a5-94dc-3fc69d5a455d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:23.662996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a8a2-8614-40a5-94dc-3fc69d5a455d admin admin] PATH_INFO: `/v3/projects/3ae0096ff37049889b2a637aca5f0350/users/7ab9251cedd641dfbaf1297e7569f1cd/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:23.692251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a8a2-8614-40a5-94dc-3fc69d5a455d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae0096ff37049889b2a637aca5f0350, user_id=7ab9251cedd641dfbaf1297e7569f1cd, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:23.722252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a8a2-8614-40a5-94dc-3fc69d5a455d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:23.745519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 874/1749] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:23 2021] PUT /identity/v3/projects/3ae0096ff37049889b2a637aca5f0350/users/7ab9251cedd641dfbaf1297e7569f1cd/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:23.749633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56e5f6-533b-45a0-9f86-c5bb52f39536 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:23.770657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56e5f6-533b-45a0-9f86-c5bb52f39536 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:23.934814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528417e-273f-419d-9e3e-7f209867156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:23.935655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528417e-273f-419d-9e3e-7f209867156d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:23.935881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528417e-273f-419d-9e3e-7f209867156d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:23.936327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528417e-273f-419d-9e3e-7f209867156d admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:23.937361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528417e-273f-419d-9e3e-7f209867156d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:23.999164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528417e-273f-419d-9e3e-7f209867156d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:24.026452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 876/1750] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:23 2021] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:24.032860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a8a2-8614-40a5-94dc-3fc69d5a455d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:24.051588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a8a2-8614-40a5-94dc-3fc69d5a455d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:24.068187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb7e1c-7510-4464-9880-8764c73e622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:24.069589 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb7e1c-7510-4464-9880-8764c73e622b admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:24.073438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb7e1c-7510-4464-9880-8764c73e622b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:24.074071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb7e1c-7510-4464-9880-8764c73e622b admin admin] PATH_INFO: `/v3/projects/3ae0096ff37049889b2a637aca5f0350/users/7ab9251cedd641dfbaf1297e7569f1cd/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:24.083435 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb7e1c-7510-4464-9880-8764c73e622b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae0096ff37049889b2a637aca5f0350, user_id=7ab9251cedd641dfbaf1297e7569f1cd, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:24.144144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb7e1c-7510-4464-9880-8764c73e622b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:24.162471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 875/1751] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:24 2021] PUT /identity/v3/projects/3ae0096ff37049889b2a637aca5f0350/users/7ab9251cedd641dfbaf1297e7569f1cd/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:24.166707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528417e-273f-419d-9e3e-7f209867156d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:24.185804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528417e-273f-419d-9e3e-7f209867156d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:24.295369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab61252-22c4-4f21-83b4-25697bbc13c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:24.298252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab61252-22c4-4f21-83b4-25697bbc13c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:24.298575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab61252-22c4-4f21-83b4-25697bbc13c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:24.298865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab61252-22c4-4f21-83b4-25697bbc13c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:24.299623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab61252-22c4-4f21-83b4-25697bbc13c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:24.349904 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab61252-22c4-4f21-83b4-25697bbc13c3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:24.368131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 877/1752] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:24 2021] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:24.372364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb7e1c-7510-4464-9880-8764c73e622b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:24.390658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb7e1c-7510-4464-9880-8764c73e622b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:24.400733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd60b9-74c1-4c7c-a179-fe187a5fdb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:24.402980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd60b9-74c1-4c7c-a179-fe187a5fdb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:24.403500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd60b9-74c1-4c7c-a179-fe187a5fdb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:24.404037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd60b9-74c1-4c7c-a179-fe187a5fdb19 admin admin] PATH_INFO: `/v3/projects/3ae0096ff37049889b2a637aca5f0350/users/7ab9251cedd641dfbaf1297e7569f1cd/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:24.407998 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd60b9-74c1-4c7c-a179-fe187a5fdb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae0096ff37049889b2a637aca5f0350, user_id=7ab9251cedd641dfbaf1297e7569f1cd, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:24.496846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd60b9-74c1-4c7c-a179-fe187a5fdb19 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:24.524055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 876/1753] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:24 2021] PUT /identity/v3/projects/3ae0096ff37049889b2a637aca5f0350/users/7ab9251cedd641dfbaf1297e7569f1cd/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:24.535464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d057c6-a002-4220-a929-09d6d06f1f47 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:24.536219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d057c6-a002-4220-a929-09d6d06f1f47 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:24.536490 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d057c6-a002-4220-a929-09d6d06f1f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:24.584033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-10d057c6-a002-4220-a929-09d6d06f1f47 None None] MFA Rules not processed for user `7ab9251cedd641dfbaf1297e7569f1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:24.585604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-10d057c6-a002-4220-a929-09d6d06f1f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:24.917927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 878/1754] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:24 2021] POST /identity/v3/auth/tokens => generated 3767 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:25.224531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd60b9-74c1-4c7c-a179-fe187a5fdb19 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:25.227640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a6bd60b9-74c1-4c7c-a179-fe187a5fdb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:25.399532 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd60b9-74c1-4c7c-a179-fe187a5fdb19 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:25.414051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528fc2d-0e05-42e1-a14d-6ab6713d670d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:25.415034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528fc2d-0e05-42e1-a14d-6ab6713d670d service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:25.415479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528fc2d-0e05-42e1-a14d-6ab6713d670d service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:25.416790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528fc2d-0e05-42e1-a14d-6ab6713d670d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:25.432023 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528fc2d-0e05-42e1-a14d-6ab6713d670d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:25.468785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528fc2d-0e05-42e1-a14d-6ab6713d670d service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:25.502407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 877/1755] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:25 2021] GET /identity/v3/auth/tokens => generated 3767 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:38:25.744324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d057c6-a002-4220-a929-09d6d06f1f47 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:25.746266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-10d057c6-a002-4220-a929-09d6d06f1f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:25.760965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d057c6-a002-4220-a929-09d6d06f1f47 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:25.768234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0fecd-0102-446b-aaf2-59ac7293e53f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:25.769253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0fecd-0102-446b-aaf2-59ac7293e53f service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:25.769756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0fecd-0102-446b-aaf2-59ac7293e53f service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:25.770238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0fecd-0102-446b-aaf2-59ac7293e53f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:25.860224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0fecd-0102-446b-aaf2-59ac7293e53f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:25.891992 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0fecd-0102-446b-aaf2-59ac7293e53f service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:25.910787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 879/1756] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:25 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:38:26.905015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528fc2d-0e05-42e1-a14d-6ab6713d670d service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:26.907496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-0528fc2d-0e05-42e1-a14d-6ab6713d670d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:27.045111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528fc2d-0e05-42e1-a14d-6ab6713d670d service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:27.050008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:27.051187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:27.051673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:27.052106 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] PATH_INFO: `/v3/users/93d7adb3d12a4999a599eeb60d9bb5fe` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:27.055523 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d7adb3d12a4999a599eeb60d9bb5fe)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:27.084195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:27.155166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d7adb3d12a4999a599eeb60d9bb5fe'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:27.169638 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d7adb3d12a4999a599eeb60d9bb5fe'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:27.171076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d7adb3d12a4999a599eeb60d9bb5fe'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:27.182916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d7adb3d12a4999a599eeb60d9bb5fe'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:27.212292 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-411048a0-3c82-4fe6-9ae2-c371ac5d52b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d7adb3d12a4999a599eeb60d9bb5fe'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:27.227820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 878/1757] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:26 2021] DELETE /identity/v3/users/93d7adb3d12a4999a599eeb60d9bb5fe => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:27.232597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0592b-163a-4bfa-9f06-91a66b77f9af None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:27.233105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0592b-163a-4bfa-9f06-91a66b77f9af None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:27.233231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0592b-163a-4bfa-9f06-91a66b77f9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:27.269864 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-ebf0592b-163a-4bfa-9f06-91a66b77f9af None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:27.271385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ebf0592b-163a-4bfa-9f06-91a66b77f9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:27.366075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 880/1758] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:27.383794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a0a20-430e-44b1-87de-483db0113649 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:27.384167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a0a20-430e-44b1-87de-483db0113649 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:27.384384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a0a20-430e-44b1-87de-483db0113649 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:27.386168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0592b-163a-4bfa-9f06-91a66b77f9af None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:27.386653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 879/1759] 10.222.0.67 () {54 vars in 921 bytes} [Thu Dec 16 14:38:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:38:27.387619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ebf0592b-163a-4bfa-9f06-91a66b77f9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:27.401674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d308ee-5f19-433e-be49-41b9d4f160b7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:27.402172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d308ee-5f19-433e-be49-41b9d4f160b7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:27.402497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d308ee-5f19-433e-be49-41b9d4f160b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:27.443114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-82d308ee-5f19-433e-be49-41b9d4f160b7 None None] MFA Rules not processed for user `f2bcc9f013f14ed89f5e94591f170b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:27.444560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-82d308ee-5f19-433e-be49-41b9d4f160b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:27.486186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0592b-163a-4bfa-9f06-91a66b77f9af None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:27.490186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ac61-83e1-4c29-8d0c-2b71eb315fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:27.490996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ac61-83e1-4c29-8d0c-2b71eb315fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:27.491385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ac61-83e1-4c29-8d0c-2b71eb315fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:27.491766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ac61-83e1-4c29-8d0c-2b71eb315fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:27.502754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ac61-83e1-4c29-8d0c-2b71eb315fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:27.546110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ac61-83e1-4c29-8d0c-2b71eb315fc1 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:27.557867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 881/1760] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:38:27.578283 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 880/1761] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Dec 16 14:38:27 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:27.591080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ac61-83e1-4c29-8d0c-2b71eb315fc1 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:27.593175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ea83ac61-83e1-4c29-8d0c-2b71eb315fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:27.627187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ac61-83e1-4c29-8d0c-2b71eb315fc1 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:27.637227 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caeb0e-ecec-4bed-a5e5-2798619d1e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:27.638581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caeb0e-ecec-4bed-a5e5-2798619d1e9c service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:27.639082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caeb0e-ecec-4bed-a5e5-2798619d1e9c service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:27.639511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caeb0e-ecec-4bed-a5e5-2798619d1e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:27.651059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caeb0e-ecec-4bed-a5e5-2798619d1e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:27.688354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caeb0e-ecec-4bed-a5e5-2798619d1e9c service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:27.700045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 882/1762] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:27 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:28.201122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d308ee-5f19-433e-be49-41b9d4f160b7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:28.204062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-82d308ee-5f19-433e-be49-41b9d4f160b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:28.232123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d308ee-5f19-433e-be49-41b9d4f160b7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:28.242657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:28.244433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:28.245158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:28.247152 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] PATH_INFO: `/v3/projects/69cb559fb5c144ea81394d5566d03237` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:28.249721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cb559fb5c144ea81394d5566d03237)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:28.319920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:28.526194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cb559fb5c144ea81394d5566d03237', 'request_id': 'req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:28.537932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cb559fb5c144ea81394d5566d03237', 'request_id': 'req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:28.547733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cb559fb5c144ea81394d5566d03237', 'request_id': 'req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:28.559652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] The token cache is being invalidate because project 69cb559fb5c144ea81394d5566d03237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:28.560146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:28.561026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-969bf6f7-4b66-4aa0-9f8a-e29034882ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:28.566954 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 881/1763] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:28 2021] DELETE /identity/v3/projects/69cb559fb5c144ea81394d5566d03237 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:28.570086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595ba8c-fda1-4708-8d78-741bad2ef828 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:28.570811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595ba8c-fda1-4708-8d78-741bad2ef828 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:28.571443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595ba8c-fda1-4708-8d78-741bad2ef828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:28.602528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1595ba8c-fda1-4708-8d78-741bad2ef828 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:28.604075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1595ba8c-fda1-4708-8d78-741bad2ef828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:28.701623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 883/1764] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:28.709355 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d697217-a102-4db0-a005-439b09d47227 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:28.709671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d697217-a102-4db0-a005-439b09d47227 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:28.709954 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d697217-a102-4db0-a005-439b09d47227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:28.733346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-0d697217-a102-4db0-a005-439b09d47227 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:28.734562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-0d697217-a102-4db0-a005-439b09d47227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:28.743520 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 882/1765] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:28.748469 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595ba8c-fda1-4708-8d78-741bad2ef828 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:28.757684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595ba8c-fda1-4708-8d78-741bad2ef828 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:28.764467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56110bca-991e-48d2-a555-d87afcfd5749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:28.765262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56110bca-991e-48d2-a555-d87afcfd5749 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:28.765776 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56110bca-991e-48d2-a555-d87afcfd5749 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:28.766083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56110bca-991e-48d2-a555-d87afcfd5749 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:28.766789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56110bca-991e-48d2-a555-d87afcfd5749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:28.767085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56110bca-991e-48d2-a555-d87afcfd5749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:28.792716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56110bca-991e-48d2-a555-d87afcfd5749 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:28.807319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 884/1766] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:38:28.811430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d697217-a102-4db0-a005-439b09d47227 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:28.820321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d697217-a102-4db0-a005-439b09d47227 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:28.825507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc68709-b96c-45d0-ae5d-58ae71cc1953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:28.826229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68709-b96c-45d0-ae5d-58ae71cc1953 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:28.826453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68709-b96c-45d0-ae5d-58ae71cc1953 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:28.826729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc68709-b96c-45d0-ae5d-58ae71cc1953 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:28.827397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc68709-b96c-45d0-ae5d-58ae71cc1953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:28.853913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc68709-b96c-45d0-ae5d-58ae71cc1953 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:28.888024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 883/1767] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:28 2021] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:28.894376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56110bca-991e-48d2-a555-d87afcfd5749 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:28.907874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56110bca-991e-48d2-a555-d87afcfd5749 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:29.028829 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5c6bb-7c1b-44ac-9ac9-d5d497c9a40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:29.029585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5c6bb-7c1b-44ac-9ac9-d5d497c9a40f admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:29.029925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5c6bb-7c1b-44ac-9ac9-d5d497c9a40f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:29.030259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5c6bb-7c1b-44ac-9ac9-d5d497c9a40f admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:29.030944 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5c6bb-7c1b-44ac-9ac9-d5d497c9a40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:29.059529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5c6bb-7c1b-44ac-9ac9-d5d497c9a40f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:29.090851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 885/1768] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:28 2021] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:29.092870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc68709-b96c-45d0-ae5d-58ae71cc1953 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:29.106084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc68709-b96c-45d0-ae5d-58ae71cc1953 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:29.122388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d081d5-7a8b-41de-87f4-117b519f692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:29.123076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d081d5-7a8b-41de-87f4-117b519f692f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:29.123363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d081d5-7a8b-41de-87f4-117b519f692f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:29.123642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d081d5-7a8b-41de-87f4-117b519f692f admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:29.124357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d081d5-7a8b-41de-87f4-117b519f692f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:29.187296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d081d5-7a8b-41de-87f4-117b519f692f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:29.203682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 884/1769] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:29 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:29.204884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5c6bb-7c1b-44ac-9ac9-d5d497c9a40f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:29.220541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5c6bb-7c1b-44ac-9ac9-d5d497c9a40f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:29.245612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75755778-0ddf-460d-a9d1-561159431335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:29.248186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75755778-0ddf-460d-a9d1-561159431335 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:29.248292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75755778-0ddf-460d-a9d1-561159431335 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:29.248541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75755778-0ddf-460d-a9d1-561159431335 admin admin] PATH_INFO: `/v3/projects/bcbb07272a8841358c74400af3987ac8/users/98d51235487747a4970c996f5ae5aaa6/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:29.303139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75755778-0ddf-460d-a9d1-561159431335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcbb07272a8841358c74400af3987ac8, user_id=98d51235487747a4970c996f5ae5aaa6, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:29.340737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75755778-0ddf-460d-a9d1-561159431335 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:29.369649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 886/1770] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:29 2021] PUT /identity/v3/projects/bcbb07272a8841358c74400af3987ac8/users/98d51235487747a4970c996f5ae5aaa6/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:29.392420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5b6f-81a8-4000-9482-109fba308246 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:29.392966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5b6f-81a8-4000-9482-109fba308246 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:29.393521 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5b6f-81a8-4000-9482-109fba308246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:29.481438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-330b5b6f-81a8-4000-9482-109fba308246 None None] MFA Rules not processed for user `98d51235487747a4970c996f5ae5aaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:29.483213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-330b5b6f-81a8-4000-9482-109fba308246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:29.623196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 885/1771] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:29 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:29.628391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75755778-0ddf-460d-a9d1-561159431335 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:29.815837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75755778-0ddf-460d-a9d1-561159431335 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:29.831069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910fd2d-13b4-4017-9b90-d3f8f37e416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:29.832017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910fd2d-13b4-4017-9b90-d3f8f37e416e admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:29.832450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910fd2d-13b4-4017-9b90-d3f8f37e416e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:29.832868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910fd2d-13b4-4017-9b90-d3f8f37e416e admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:29.833762 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910fd2d-13b4-4017-9b90-d3f8f37e416e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:29.882209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910fd2d-13b4-4017-9b90-d3f8f37e416e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:29.928464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 887/1772] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:29 2021] POST /identity/v3/projects => generated 377 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:29.928675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5b6f-81a8-4000-9482-109fba308246 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:29.939525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5b6f-81a8-4000-9482-109fba308246 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:30.074181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ede0e-115e-46c2-b1fb-119f41404540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:30.074950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ede0e-115e-46c2-b1fb-119f41404540 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:30.075325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ede0e-115e-46c2-b1fb-119f41404540 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:30.075747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ede0e-115e-46c2-b1fb-119f41404540 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:30.076486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ede0e-115e-46c2-b1fb-119f41404540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:30.103665 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ede0e-115e-46c2-b1fb-119f41404540 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:30.128849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 886/1773] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:29 2021] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:30.134040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910fd2d-13b4-4017-9b90-d3f8f37e416e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:30.145758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910fd2d-13b4-4017-9b90-d3f8f37e416e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:30.152185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b2a98-94fa-4949-8155-b7b4529808fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:30.152837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b2a98-94fa-4949-8155-b7b4529808fc admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:30.153132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b2a98-94fa-4949-8155-b7b4529808fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:30.153407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b2a98-94fa-4949-8155-b7b4529808fc admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:30.154212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b2a98-94fa-4949-8155-b7b4529808fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:30.182663 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b2a98-94fa-4949-8155-b7b4529808fc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:30.199881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 888/1774] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:30 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:30.201078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ede0e-115e-46c2-b1fb-119f41404540 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:30.213409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ede0e-115e-46c2-b1fb-119f41404540 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:30.219039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b9ae-fdea-4f4d-968e-052c6a80029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:30.220546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b9ae-fdea-4f4d-968e-052c6a80029b admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:30.220546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b9ae-fdea-4f4d-968e-052c6a80029b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:30.220546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b9ae-fdea-4f4d-968e-052c6a80029b admin admin] PATH_INFO: `/v3/projects/e8def4fd20cd44d389d4dffcbc872b94/users/8a3f074fbe7b47768b90955f10f89d03/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:30.247375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706b9ae-fdea-4f4d-968e-052c6a80029b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8def4fd20cd44d389d4dffcbc872b94, user_id=8a3f074fbe7b47768b90955f10f89d03, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:30.275465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706b9ae-fdea-4f4d-968e-052c6a80029b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:30.292553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 887/1775] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:30 2021] PUT /identity/v3/projects/e8def4fd20cd44d389d4dffcbc872b94/users/8a3f074fbe7b47768b90955f10f89d03/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:30.304289 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ad674-711c-44fd-978d-ab8419f00199 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:30.304957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ad674-711c-44fd-978d-ab8419f00199 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:30.305232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ad674-711c-44fd-978d-ab8419f00199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:30.356380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1b6ad674-711c-44fd-978d-ab8419f00199 None None] MFA Rules not processed for user `8a3f074fbe7b47768b90955f10f89d03`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:30.357836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1b6ad674-711c-44fd-978d-ab8419f00199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:30.450704 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 889/1776] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:30 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:30.455534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b9ae-fdea-4f4d-968e-052c6a80029b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:30.540575 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b9ae-fdea-4f4d-968e-052c6a80029b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:30.546537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c29a85-1ace-41cb-93e9-3d4be54b31f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:30.547463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29a85-1ace-41cb-93e9-3d4be54b31f3 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:30.547907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29a85-1ace-41cb-93e9-3d4be54b31f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:30.548445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29a85-1ace-41cb-93e9-3d4be54b31f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:30.549382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c29a85-1ace-41cb-93e9-3d4be54b31f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:30.581329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c29a85-1ace-41cb-93e9-3d4be54b31f3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:30.632078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 888/1777] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:30 2021] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:30.637802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ad674-711c-44fd-978d-ab8419f00199 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:30.654391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ad674-711c-44fd-978d-ab8419f00199 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:30.812845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6372273-a0c8-4b29-9792-7d293c67f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:30.813860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6372273-a0c8-4b29-9792-7d293c67f401 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:30.814381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6372273-a0c8-4b29-9792-7d293c67f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:30.815107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6372273-a0c8-4b29-9792-7d293c67f401 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:30.815932 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6372273-a0c8-4b29-9792-7d293c67f401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:30.872151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6372273-a0c8-4b29-9792-7d293c67f401 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:30.904979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 890/1778] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:30 2021] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:30.910225 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c29a85-1ace-41cb-93e9-3d4be54b31f3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:30.932347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c29a85-1ace-41cb-93e9-3d4be54b31f3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:30.944124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897871c9-de5c-4d64-9aae-b97a1c734783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:30.944823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897871c9-de5c-4d64-9aae-b97a1c734783 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:30.945307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897871c9-de5c-4d64-9aae-b97a1c734783 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:30.945550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897871c9-de5c-4d64-9aae-b97a1c734783 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:30.946769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897871c9-de5c-4d64-9aae-b97a1c734783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:30.980832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897871c9-de5c-4d64-9aae-b97a1c734783 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:30.994613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 889/1779] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:30 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:30.998461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6372273-a0c8-4b29-9792-7d293c67f401 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:31.011134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6372273-a0c8-4b29-9792-7d293c67f401 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:31.016185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40736-6381-45b4-ae11-1c55e6613455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:31.017050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40736-6381-45b4-ae11-1c55e6613455 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:31.017361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40736-6381-45b4-ae11-1c55e6613455 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:31.018029 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40736-6381-45b4-ae11-1c55e6613455 admin admin] PATH_INFO: `/v3/projects/0284b9eb80f94b20b79fff196372f50a/users/3d5760ad612d4d1eb77de5a3890b7d41/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:31.045772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc40736-6381-45b4-ae11-1c55e6613455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0284b9eb80f94b20b79fff196372f50a, user_id=3d5760ad612d4d1eb77de5a3890b7d41, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:31.076940 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc40736-6381-45b4-ae11-1c55e6613455 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:31.109103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 891/1780] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:30 2021] PUT /identity/v3/projects/0284b9eb80f94b20b79fff196372f50a/users/3d5760ad612d4d1eb77de5a3890b7d41/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:31.113397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897871c9-de5c-4d64-9aae-b97a1c734783 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:31.127710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897871c9-de5c-4d64-9aae-b97a1c734783 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:31.235965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2dd4-036d-4756-aac6-757d1d2fa6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:31.236641 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2dd4-036d-4756-aac6-757d1d2fa6bf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:31.236869 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2dd4-036d-4756-aac6-757d1d2fa6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:31.237146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2dd4-036d-4756-aac6-757d1d2fa6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:31.237861 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb2dd4-036d-4756-aac6-757d1d2fa6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:31.269703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb2dd4-036d-4756-aac6-757d1d2fa6bf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:31.294013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 890/1781] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:31.296232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40736-6381-45b4-ae11-1c55e6613455 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:31.308853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40736-6381-45b4-ae11-1c55e6613455 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:31.331756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d34a4-89a4-45df-aaaa-9d1dab827c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:31.334890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d34a4-89a4-45df-aaaa-9d1dab827c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:31.335212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d34a4-89a4-45df-aaaa-9d1dab827c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:31.335578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d34a4-89a4-45df-aaaa-9d1dab827c11 admin admin] PATH_INFO: `/v3/projects/0284b9eb80f94b20b79fff196372f50a/users/3d5760ad612d4d1eb77de5a3890b7d41/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:31.346076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d34a4-89a4-45df-aaaa-9d1dab827c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0284b9eb80f94b20b79fff196372f50a, user_id=3d5760ad612d4d1eb77de5a3890b7d41, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:31.460656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d34a4-89a4-45df-aaaa-9d1dab827c11 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:31.514678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 892/1782] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:31 2021] PUT /identity/v3/projects/0284b9eb80f94b20b79fff196372f50a/users/3d5760ad612d4d1eb77de5a3890b7d41/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:31.528782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2dd4-036d-4756-aac6-757d1d2fa6bf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:31.541466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2dd4-036d-4756-aac6-757d1d2fa6bf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:31.716216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e22004-dfc1-4418-84e1-256658827ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:31.717246 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e22004-dfc1-4418-84e1-256658827ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:31.717701 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e22004-dfc1-4418-84e1-256658827ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:31.718167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e22004-dfc1-4418-84e1-256658827ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:31.719020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e22004-dfc1-4418-84e1-256658827ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:31.792206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e22004-dfc1-4418-84e1-256658827ef7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:31.815240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 891/1783] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:31.819323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d34a4-89a4-45df-aaaa-9d1dab827c11 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:31.829663 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d34a4-89a4-45df-aaaa-9d1dab827c11 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:31.834015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867c88b-b109-4b2f-bd63-3f0524122889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:31.834855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867c88b-b109-4b2f-bd63-3f0524122889 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:31.835137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867c88b-b109-4b2f-bd63-3f0524122889 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:31.836135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867c88b-b109-4b2f-bd63-3f0524122889 admin admin] PATH_INFO: `/v3/projects/0284b9eb80f94b20b79fff196372f50a/users/3d5760ad612d4d1eb77de5a3890b7d41/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:31.838294 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867c88b-b109-4b2f-bd63-3f0524122889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0284b9eb80f94b20b79fff196372f50a, user_id=3d5760ad612d4d1eb77de5a3890b7d41, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:31.866159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867c88b-b109-4b2f-bd63-3f0524122889 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:31.888605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 893/1784] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:31 2021] PUT /identity/v3/projects/0284b9eb80f94b20b79fff196372f50a/users/3d5760ad612d4d1eb77de5a3890b7d41/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:31.898747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd115fac-a570-4a9a-9d18-754b210b2494 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:31.899590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd115fac-a570-4a9a-9d18-754b210b2494 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:31.899950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd115fac-a570-4a9a-9d18-754b210b2494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:31.954831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-cd115fac-a570-4a9a-9d18-754b210b2494 None None] MFA Rules not processed for user `3d5760ad612d4d1eb77de5a3890b7d41`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:31.956878 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cd115fac-a570-4a9a-9d18-754b210b2494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:32.137106 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 892/1785] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:31 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:32.143231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867c88b-b109-4b2f-bd63-3f0524122889 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:32.144942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2867c88b-b109-4b2f-bd63-3f0524122889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:32.228122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867c88b-b109-4b2f-bd63-3f0524122889 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:32.232376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043a755-2464-40fe-8753-f0b978856ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:32.232971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a755-2464-40fe-8753-f0b978856ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:32.233278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a755-2464-40fe-8753-f0b978856ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:32.233565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a755-2464-40fe-8753-f0b978856ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:32.243622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043a755-2464-40fe-8753-f0b978856ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:32.269559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043a755-2464-40fe-8753-f0b978856ea5 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:32.280470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 894/1786] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:32 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:32.351013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd115fac-a570-4a9a-9d18-754b210b2494 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:32.376378 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd115fac-a570-4a9a-9d18-754b210b2494 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:32.380754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfc5e2-eb16-49b9-b68d-ad4ebbe88b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:32.381679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfc5e2-eb16-49b9-b68d-ad4ebbe88b58 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:32.382326 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfc5e2-eb16-49b9-b68d-ad4ebbe88b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:32.382461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfc5e2-eb16-49b9-b68d-ad4ebbe88b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:32.484189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfc5e2-eb16-49b9-b68d-ad4ebbe88b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:32.511686 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfc5e2-eb16-49b9-b68d-ad4ebbe88b58 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:32.522022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 893/1787] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:32 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:37.479695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e30d-34fe-4523-b84c-31c4d6e67d89 None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:37.480324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e30d-34fe-4523-b84c-31c4d6e67d89 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:37.480324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e30d-34fe-4523-b84c-31c4d6e67d89 None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:37.482104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 895/1788] 10.222.0.67 () {54 vars in 921 bytes} [Thu Dec 16 14:38:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:38:37.489767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857180-ca03-407a-8129-59cd7499ef09 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:37.491006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857180-ca03-407a-8129-59cd7499ef09 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:37.491316 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857180-ca03-407a-8129-59cd7499ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:37.524390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-69857180-ca03-407a-8129-59cd7499ef09 None None] MFA Rules not processed for user `f2bcc9f013f14ed89f5e94591f170b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:37.525682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-69857180-ca03-407a-8129-59cd7499ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:37.614051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 894/1789] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Dec 16 14:38:37 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:37.627602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e30d-34fe-4523-b84c-31c4d6e67d89 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:37.629433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d1e0e30d-34fe-4523-b84c-31c4d6e67d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:37.647169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e30d-34fe-4523-b84c-31c4d6e67d89 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:37.654220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e7a69-d9cb-44a2-845a-ff3640112a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:37.654824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7a69-d9cb-44a2-845a-ff3640112a0e service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:37.655109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7a69-d9cb-44a2-845a-ff3640112a0e service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:37.655386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7a69-d9cb-44a2-845a-ff3640112a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:37.665488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e7a69-d9cb-44a2-845a-ff3640112a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:37.691605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e7a69-d9cb-44a2-845a-ff3640112a0e service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:37.702573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 896/1790] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:37 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:41.756731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69857180-ca03-407a-8129-59cd7499ef09 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:41.759764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-69857180-ca03-407a-8129-59cd7499ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:41.919118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69857180-ca03-407a-8129-59cd7499ef09 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:41.927698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:41.928911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:41.929204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:41.929734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] PATH_INFO: `/v3/users/e64b24d3646d41c298f13280be90fbe5` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:41.931318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64b24d3646d41c298f13280be90fbe5)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:41.966444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:42.062210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64b24d3646d41c298f13280be90fbe5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.072960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64b24d3646d41c298f13280be90fbe5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.073977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64b24d3646d41c298f13280be90fbe5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.084695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e7a69-d9cb-44a2-845a-ff3640112a0e service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:42.105478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64b24d3646d41c298f13280be90fbe5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.109954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e7a69-d9cb-44a2-845a-ff3640112a0e service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:42.126173 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:42.127875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:42.128542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:42.129643 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] PATH_INFO: `/v3/users/98d51235487747a4970c996f5ae5aaa6` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:42.132197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d51235487747a4970c996f5ae5aaa6)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:42.151516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-98e20953-391f-4e92-903d-65a82b3e260c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64b24d3646d41c298f13280be90fbe5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.174047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 895/1791] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:41 2021] DELETE /identity/v3/users/e64b24d3646d41c298f13280be90fbe5 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:42.176053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284091a0-4cd4-43bd-b9c4-bdd5e1211503 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:42.179890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284091a0-4cd4-43bd-b9c4-bdd5e1211503 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:42.180330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284091a0-4cd4-43bd-b9c4-bdd5e1211503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:42.204007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:42.262571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-284091a0-4cd4-43bd-b9c4-bdd5e1211503 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:42.264619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-284091a0-4cd4-43bd-b9c4-bdd5e1211503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:42.278309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d51235487747a4970c996f5ae5aaa6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.295026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d51235487747a4970c996f5ae5aaa6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.305835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d51235487747a4970c996f5ae5aaa6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.306914 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d51235487747a4970c996f5ae5aaa6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.319654 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6aa51236-e9ec-4757-9146-fa8875bd47b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d51235487747a4970c996f5ae5aaa6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:42.329199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 897/1792] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:42 2021] DELETE /identity/v3/users/98d51235487747a4970c996f5ae5aaa6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:42.335100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192227b-215d-4e3d-9625-6daf792b0669 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:42.336228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192227b-215d-4e3d-9625-6daf792b0669 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:42.336694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192227b-215d-4e3d-9625-6daf792b0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:42.374741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0192227b-215d-4e3d-9625-6daf792b0669 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:42.377636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0192227b-215d-4e3d-9625-6daf792b0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:42.389234 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 896/1793] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:42.409012 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284091a0-4cd4-43bd-b9c4-bdd5e1211503 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:42.412804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-284091a0-4cd4-43bd-b9c4-bdd5e1211503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:42.558669 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 898/1794] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:42.567021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192227b-215d-4e3d-9625-6daf792b0669 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:42.568563 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0192227b-215d-4e3d-9625-6daf792b0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:42.576775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284091a0-4cd4-43bd-b9c4-bdd5e1211503 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:42.694814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192227b-215d-4e3d-9625-6daf792b0669 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:42.695110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644246af-6816-4697-82ed-934624c82572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:42.695670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644246af-6816-4697-82ed-934624c82572 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:42.695957 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644246af-6816-4697-82ed-934624c82572 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:42.696301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644246af-6816-4697-82ed-934624c82572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:42.707251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a8faa-bd47-426a-a82d-b035cb9f2fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:42.708054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a8faa-bd47-426a-a82d-b035cb9f2fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:42.708344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a8faa-bd47-426a-a82d-b035cb9f2fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:42.708633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a8faa-bd47-426a-a82d-b035cb9f2fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:42.708814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644246af-6816-4697-82ed-934624c82572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:42.737637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a8faa-bd47-426a-a82d-b035cb9f2fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:42.738422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644246af-6816-4697-82ed-934624c82572 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:42.757702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 897/1795] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:42.781612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a8faa-bd47-426a-a82d-b035cb9f2fc9 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:42.806609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 899/1796] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:38:43.065607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644246af-6816-4697-82ed-934624c82572 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:43.067036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-644246af-6816-4697-82ed-934624c82572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:43.082321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644246af-6816-4697-82ed-934624c82572 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:43.087372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:43.088671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:43.089004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:43.089291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] PATH_INFO: `/v3/users/d855c6ff5d54404ebcd529a5f0093a97` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:43.091402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d855c6ff5d54404ebcd529a5f0093a97)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:43.123590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:43.232983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd855c6ff5d54404ebcd529a5f0093a97'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.249422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd855c6ff5d54404ebcd529a5f0093a97'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.251806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd855c6ff5d54404ebcd529a5f0093a97'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.269466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd855c6ff5d54404ebcd529a5f0093a97'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.287379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd855c6ff5d54404ebcd529a5f0093a97'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.296849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 898/1797] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:43 2021] DELETE /identity/v3/users/d855c6ff5d54404ebcd529a5f0093a97 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:43.302347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c279830-4127-48fd-b873-4cddd35e39ca None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:43.302827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c279830-4127-48fd-b873-4cddd35e39ca None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:43.303057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c279830-4127-48fd-b873-4cddd35e39ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:43.340153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-4c279830-4127-48fd-b873-4cddd35e39ca None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:43.341412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4c279830-4127-48fd-b873-4cddd35e39ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:43.494139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:43.496172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:43.516232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 900/1798] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:43.528685 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66975-2a27-409a-bf82-2bb2b31fb024 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:43.531037 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c279830-4127-48fd-b873-4cddd35e39ca None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:43.533519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4c279830-4127-48fd-b873-4cddd35e39ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:43.562965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:43.564252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:43.565013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:43.565573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] PATH_INFO: `/v3/projects/6dfb7fa8a2be4e5b87aabde6afbdb510` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:43.567662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dfb7fa8a2be4e5b87aabde6afbdb510)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:43.612327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:43.650851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c279830-4127-48fd-b873-4cddd35e39ca None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:43.655163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41175f9f-8944-42e7-bf93-7126eba3d58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:43.656121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41175f9f-8944-42e7-bf93-7126eba3d58d service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:43.656502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41175f9f-8944-42e7-bf93-7126eba3d58d service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:43.656873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41175f9f-8944-42e7-bf93-7126eba3d58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:43.668295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41175f9f-8944-42e7-bf93-7126eba3d58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:43.689842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dfb7fa8a2be4e5b87aabde6afbdb510', 'request_id': 'req-5fac49b0-0aba-4145-8b79-08948d3bdb76'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.703043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41175f9f-8944-42e7-bf93-7126eba3d58d service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:43.710946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dfb7fa8a2be4e5b87aabde6afbdb510', 'request_id': 'req-5fac49b0-0aba-4145-8b79-08948d3bdb76'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.719438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 901/1799] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:38:43.720596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41175f9f-8944-42e7-bf93-7126eba3d58d service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:43.722592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dfb7fa8a2be4e5b87aabde6afbdb510', 'request_id': 'req-5fac49b0-0aba-4145-8b79-08948d3bdb76'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.723034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-41175f9f-8944-42e7-bf93-7126eba3d58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:43.738745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] The token cache is being invalidate because project 6dfb7fa8a2be4e5b87aabde6afbdb510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:43.739335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.740141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.746432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 899/1800] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:43 2021] DELETE /identity/v3/projects/6dfb7fa8a2be4e5b87aabde6afbdb510 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:43.747684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41175f9f-8944-42e7-bf93-7126eba3d58d service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:43.751531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:43.755354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:43.859065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac49b0-0aba-4145-8b79-08948d3bdb76 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:43.869715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:43.870608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:43.871127 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:43.871497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:43.872314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] PATH_INFO: `/v3/users/7ab9251cedd641dfbaf1297e7569f1cd` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:43.873561 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab9251cedd641dfbaf1297e7569f1cd)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:43.879126 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:43.879569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:43.879977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] PATH_INFO: `/v3/projects/bcbb07272a8841358c74400af3987ac8` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:43.881387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcbb07272a8841358c74400af3987ac8)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:43.899770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:43.913348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:43.981688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab9251cedd641dfbaf1297e7569f1cd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.983831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcbb07272a8841358c74400af3987ac8', 'request_id': 'req-93e3a16e-d851-446c-91b8-729f6a4cd72c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.995176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab9251cedd641dfbaf1297e7569f1cd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:43.998634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab9251cedd641dfbaf1297e7569f1cd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.004489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcbb07272a8841358c74400af3987ac8', 'request_id': 'req-93e3a16e-d851-446c-91b8-729f6a4cd72c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.014813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcbb07272a8841358c74400af3987ac8', 'request_id': 'req-93e3a16e-d851-446c-91b8-729f6a4cd72c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.021741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab9251cedd641dfbaf1297e7569f1cd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.033420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] The token cache is being invalidate because project bcbb07272a8841358c74400af3987ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:44.033931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.034936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.037594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 902/1801] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:43 2021] DELETE /identity/v3/projects/bcbb07272a8841358c74400af3987ac8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:44.041938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:44.043893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab9251cedd641dfbaf1297e7569f1cd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.044960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:44.058231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 900/1802] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:43 2021] DELETE /identity/v3/users/7ab9251cedd641dfbaf1297e7569f1cd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:44.162908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3a16e-d851-446c-91b8-729f6a4cd72c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:44.262958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:44.264403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:44.265244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:44.265719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] PATH_INFO: `/v3/users/8a3f074fbe7b47768b90955f10f89d03` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:44.269455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3f074fbe7b47768b90955f10f89d03)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:44.302890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:44.384821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3f074fbe7b47768b90955f10f89d03'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.401303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3f074fbe7b47768b90955f10f89d03'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.421475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3f074fbe7b47768b90955f10f89d03'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.422162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3f074fbe7b47768b90955f10f89d03'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.438937 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3f074fbe7b47768b90955f10f89d03'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.454690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 903/1803] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:44 2021] DELETE /identity/v3/users/8a3f074fbe7b47768b90955f10f89d03 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:44.456615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:44.463314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:44.487060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc1c1d-18da-4990-a3e4-96396b0ac11d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:44.646906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:44.651810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:44.652274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:44.652790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] PATH_INFO: `/v3/projects/be57c1f88c1c41d48335ae667c4a7038` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:44.663245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be57c1f88c1c41d48335ae667c4a7038)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:44.719969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:44.801958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be57c1f88c1c41d48335ae667c4a7038', 'request_id': 'req-c699cba9-1842-4097-90de-913db8a4ee33'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.825194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be57c1f88c1c41d48335ae667c4a7038', 'request_id': 'req-c699cba9-1842-4097-90de-913db8a4ee33'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.842118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be57c1f88c1c41d48335ae667c4a7038', 'request_id': 'req-c699cba9-1842-4097-90de-913db8a4ee33'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.859660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] The token cache is being invalidate because project be57c1f88c1c41d48335ae667c4a7038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:44.860333 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.861216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:44.865590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 901/1804] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:44 2021] DELETE /identity/v3/projects/be57c1f88c1c41d48335ae667c4a7038 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:44.870393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:44.872805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:44.898771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a4c64-3216-4286-b474-46c52611d7d8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:45.122501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:45.124313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:45.184721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:45.186563 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:45.187439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:45.188583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] PATH_INFO: `/v3/users/2e35e9a9f26842639f24033f00dbd6cd` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:45.191015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e35e9a9f26842639f24033f00dbd6cd)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:45.257150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:45.336807 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699cba9-1842-4097-90de-913db8a4ee33 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:45.345447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:45.347064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:45.347365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:45.347647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] PATH_INFO: `/v3/projects/3ae0096ff37049889b2a637aca5f0350` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:45.350126 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae0096ff37049889b2a637aca5f0350)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:45.366457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e35e9a9f26842639f24033f00dbd6cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.384268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:45.399121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e35e9a9f26842639f24033f00dbd6cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.427140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e35e9a9f26842639f24033f00dbd6cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.429117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e35e9a9f26842639f24033f00dbd6cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.442137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1e86133e-f57a-43f0-b447-08707a7ed092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e35e9a9f26842639f24033f00dbd6cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.454756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 904/1805] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:44 2021] DELETE /identity/v3/users/2e35e9a9f26842639f24033f00dbd6cd => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:45.469874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae0096ff37049889b2a637aca5f0350', 'request_id': 'req-da696fde-b718-4b8d-8b98-5916398bd152'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.493398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae0096ff37049889b2a637aca5f0350', 'request_id': 'req-da696fde-b718-4b8d-8b98-5916398bd152'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.507801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae0096ff37049889b2a637aca5f0350', 'request_id': 'req-da696fde-b718-4b8d-8b98-5916398bd152'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.533486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] The token cache is being invalidate because project 3ae0096ff37049889b2a637aca5f0350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:45.534363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.536025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:45.539457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 902/1806] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:45 2021] DELETE /identity/v3/projects/3ae0096ff37049889b2a637aca5f0350 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:45.547385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424812e1-4124-4422-a70d-d21227279bee None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:45.548043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424812e1-4124-4422-a70d-d21227279bee None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:45.548629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424812e1-4124-4422-a70d-d21227279bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:45.598418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-424812e1-4124-4422-a70d-d21227279bee None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:45.600991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-424812e1-4124-4422-a70d-d21227279bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:45.760753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:45.763724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:45.779555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 905/1807] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:45.792549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ab5c-a707-4635-87f8-1df6bb695999 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:45.793094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ab5c-a707-4635-87f8-1df6bb695999 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:45.793942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ab5c-a707-4635-87f8-1df6bb695999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:45.838946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-3c55ab5c-a707-4635-87f8-1df6bb695999 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:45.841171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3c55ab5c-a707-4635-87f8-1df6bb695999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:45.857512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 906/1808] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:45.861875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ab5c-a707-4635-87f8-1df6bb695999 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:45.877972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ab5c-a707-4635-87f8-1df6bb695999 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:45.886686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbdacf-c6f4-45e1-9fb4-e31ef83b2579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:45.887471 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbdacf-c6f4-45e1-9fb4-e31ef83b2579 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:45.887927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbdacf-c6f4-45e1-9fb4-e31ef83b2579 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:45.888359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbdacf-c6f4-45e1-9fb4-e31ef83b2579 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:45.890038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbdacf-c6f4-45e1-9fb4-e31ef83b2579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:45.890484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbdacf-c6f4-45e1-9fb4-e31ef83b2579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:45.908702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696fde-b718-4b8d-8b98-5916398bd152 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:45.920344 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:45.923104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:45.923823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:45.924676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] PATH_INFO: `/v3/projects/e8def4fd20cd44d389d4dffcbc872b94` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:45.929235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8def4fd20cd44d389d4dffcbc872b94)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:45.942037 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbdacf-c6f4-45e1-9fb4-e31ef83b2579 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:45.982186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 907/1809] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:38:45.989674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:45.989946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbdacf-c6f4-45e1-9fb4-e31ef83b2579 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:46.021527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbdacf-c6f4-45e1-9fb4-e31ef83b2579 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:46.028281 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9757-cf29-482c-966d-adea6d6d83e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:46.029189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9757-cf29-482c-966d-adea6d6d83e4 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.029485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9757-cf29-482c-966d-adea6d6d83e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.029772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9757-cf29-482c-966d-adea6d6d83e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.030486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9757-cf29-482c-966d-adea6d6d83e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:46.060364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9757-cf29-482c-966d-adea6d6d83e4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:46.104022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 908/1810] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:45 2021] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:46.108298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8def4fd20cd44d389d4dffcbc872b94', 'request_id': 'req-70c36214-aff5-4aa7-b717-207f91eae197'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.109820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9757-cf29-482c-966d-adea6d6d83e4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:46.138465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8def4fd20cd44d389d4dffcbc872b94', 'request_id': 'req-70c36214-aff5-4aa7-b717-207f91eae197'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.155128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8def4fd20cd44d389d4dffcbc872b94', 'request_id': 'req-70c36214-aff5-4aa7-b717-207f91eae197'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.184036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] The token cache is being invalidate because project e8def4fd20cd44d389d4dffcbc872b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:46.184345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.188339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.191885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 903/1811] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:45 2021] DELETE /identity/v3/projects/e8def4fd20cd44d389d4dffcbc872b94 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:46.202196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:46.202196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:46.253243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9757-cf29-482c-966d-adea6d6d83e4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:46.259959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7005dd-a88a-49fd-85f9-a7a8c9c64dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:46.261259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7005dd-a88a-49fd-85f9-a7a8c9c64dad admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.261458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7005dd-a88a-49fd-85f9-a7a8c9c64dad admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.261755 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7005dd-a88a-49fd-85f9-a7a8c9c64dad admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.262489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7005dd-a88a-49fd-85f9-a7a8c9c64dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:46.302863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7005dd-a88a-49fd-85f9-a7a8c9c64dad admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:46.331612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c36214-aff5-4aa7-b717-207f91eae197 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:46.334154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 909/1812] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:46 2021] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:46.335811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7005dd-a88a-49fd-85f9-a7a8c9c64dad admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:46.339514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6f7005dd-a88a-49fd-85f9-a7a8c9c64dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:46.341007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:46.342028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.342353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.343080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] PATH_INFO: `/v3/users/3d5760ad612d4d1eb77de5a3890b7d41` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.344601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5760ad612d4d1eb77de5a3890b7d41)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:46.360371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7005dd-a88a-49fd-85f9-a7a8c9c64dad admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:46.367796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:46.369609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.370149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.370652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] PATH_INFO: `/v3/projects/19ea94337b4d42b78e06b019fbc02000` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.372776 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ea94337b4d42b78e06b019fbc02000)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:46.374945 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:46.429085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:46.445793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5760ad612d4d1eb77de5a3890b7d41'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.458209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5760ad612d4d1eb77de5a3890b7d41'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.459340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5760ad612d4d1eb77de5a3890b7d41'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.472374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5760ad612d4d1eb77de5a3890b7d41'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.495156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5760ad612d4d1eb77de5a3890b7d41'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.504074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ea94337b4d42b78e06b019fbc02000', 'request_id': 'req-67d2b3bd-1c18-4332-b97b-96118b7cf348'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.507722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 904/1813] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:46 2021] DELETE /identity/v3/users/3d5760ad612d4d1eb77de5a3890b7d41 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:46.509256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:46.512073 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:46.523111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ea94337b4d42b78e06b019fbc02000', 'request_id': 'req-67d2b3bd-1c18-4332-b97b-96118b7cf348'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.536340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ea94337b4d42b78e06b019fbc02000', 'request_id': 'req-67d2b3bd-1c18-4332-b97b-96118b7cf348'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.555589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] The token cache is being invalidate because project 19ea94337b4d42b78e06b019fbc02000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:46.555917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.556607 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-67d2b3bd-1c18-4332-b97b-96118b7cf348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:46.559436 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 910/1814] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:46 2021] DELETE /identity/v3/projects/19ea94337b4d42b78e06b019fbc02000 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:46.570110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424b7ba-4041-4227-8e19-a67abaebcd80 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.570389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424b7ba-4041-4227-8e19-a67abaebcd80 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.570674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424b7ba-4041-4227-8e19-a67abaebcd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.609600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c424b7ba-4041-4227-8e19-a67abaebcd80 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:46.611359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c424b7ba-4041-4227-8e19-a67abaebcd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:46.641841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0bea1-d6b6-46c0-874c-7d0ef5bf8e43 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:46.647931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af459a-d203-4c71-8949-7b2045b19506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:46.650432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af459a-d203-4c71-8949-7b2045b19506 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.650432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af459a-d203-4c71-8949-7b2045b19506 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.650432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af459a-d203-4c71-8949-7b2045b19506 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.651352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af459a-d203-4c71-8949-7b2045b19506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:46.694749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af459a-d203-4c71-8949-7b2045b19506 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:46.718491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 905/1815] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:46 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:46.718775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 911/1816] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:46.723574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af459a-d203-4c71-8949-7b2045b19506 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:46.726366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a9af459a-d203-4c71-8949-7b2045b19506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:46.726793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd461a75-7b97-49b3-b5df-de1b5da6a7a3 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.727090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd461a75-7b97-49b3-b5df-de1b5da6a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.727371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd461a75-7b97-49b3-b5df-de1b5da6a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.753551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af459a-d203-4c71-8949-7b2045b19506 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:46.764182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c0fbc-1f0d-48a3-9df2-41ded9726a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:46.765862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0fbc-1f0d-48a3-9df2-41ded9726a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.766692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0fbc-1f0d-48a3-9df2-41ded9726a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.767047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-fd461a75-7b97-49b3-b5df-de1b5da6a7a3 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:46.767338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0fbc-1f0d-48a3-9df2-41ded9726a84 admin admin] PATH_INFO: `/v3/projects/c0c884cdc1bd4510afae9792e723e566/users/99163beb6e7f4cdb919a5a4214afcf81/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.769180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-fd461a75-7b97-49b3-b5df-de1b5da6a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:46.786250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 912/1817] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:46.787457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd461a75-7b97-49b3-b5df-de1b5da6a7a3 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:46.800481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd461a75-7b97-49b3-b5df-de1b5da6a7a3 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:46.808237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cba3bc-a2c0-4547-a2cd-c5867b57d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:46.809150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c0fbc-1f0d-48a3-9df2-41ded9726a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c884cdc1bd4510afae9792e723e566, user_id=99163beb6e7f4cdb919a5a4214afcf81, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:46.809730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cba3bc-a2c0-4547-a2cd-c5867b57d5dc admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.810225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cba3bc-a2c0-4547-a2cd-c5867b57d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.810685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cba3bc-a2c0-4547-a2cd-c5867b57d5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.811627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cba3bc-a2c0-4547-a2cd-c5867b57d5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:46.812240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cba3bc-a2c0-4547-a2cd-c5867b57d5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:46.841015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c0fbc-1f0d-48a3-9df2-41ded9726a84 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:46.849694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cba3bc-a2c0-4547-a2cd-c5867b57d5dc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:46.871685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 913/1818] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:38:46.872931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cba3bc-a2c0-4547-a2cd-c5867b57d5dc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:46.873566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 906/1819] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:46 2021] PUT /identity/v3/projects/c0c884cdc1bd4510afae9792e723e566/users/99163beb6e7f4cdb919a5a4214afcf81/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:46.887436 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55d48-09ee-4acf-8beb-15c54358d2e2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:46.887716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55d48-09ee-4acf-8beb-15c54358d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:46.887998 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55d48-09ee-4acf-8beb-15c54358d2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:46.900330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cba3bc-a2c0-4547-a2cd-c5867b57d5dc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:46.949958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-85d55d48-09ee-4acf-8beb-15c54358d2e2 None None] MFA Rules not processed for user `99163beb6e7f4cdb919a5a4214afcf81`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:46.951615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-85d55d48-09ee-4acf-8beb-15c54358d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:47.050243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaf181-f58c-4ea7-ab9b-cd7e9432f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:47.051593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf181-f58c-4ea7-ab9b-cd7e9432f8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:47.052306 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf181-f58c-4ea7-ab9b-cd7e9432f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:47.052992 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaf181-f58c-4ea7-ab9b-cd7e9432f8a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:47.054586 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaf181-f58c-4ea7-ab9b-cd7e9432f8a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:47.078159 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 907/1820] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:46 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:47.080141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55d48-09ee-4acf-8beb-15c54358d2e2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:47.123067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaf181-f58c-4ea7-ab9b-cd7e9432f8a4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:47.126714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55d48-09ee-4acf-8beb-15c54358d2e2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:47.154104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3abf-ba33-4b46-bb21-7252e081e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:47.155757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3abf-ba33-4b46-bb21-7252e081e327 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:47.156501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3abf-ba33-4b46-bb21-7252e081e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:47.157061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3abf-ba33-4b46-bb21-7252e081e327 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:47.160438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3abf-ba33-4b46-bb21-7252e081e327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:47.163052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 914/1821] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:46 2021] POST /identity/v3/projects => generated 363 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:47.169265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaf181-f58c-4ea7-ab9b-cd7e9432f8a4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:47.265086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3abf-ba33-4b46-bb21-7252e081e327 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:47.320945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaf181-f58c-4ea7-ab9b-cd7e9432f8a4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:47.328953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0d91f-151b-4f73-a558-ed63ac0026bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:47.330267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0d91f-151b-4f73-a558-ed63ac0026bf admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:47.330555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0d91f-151b-4f73-a558-ed63ac0026bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:47.330877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0d91f-151b-4f73-a558-ed63ac0026bf admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:47.331596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0d91f-151b-4f73-a558-ed63ac0026bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:47.333526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 908/1822] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:47 2021] POST /identity/v3/projects => generated 389 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:47.337684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3abf-ba33-4b46-bb21-7252e081e327 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:47.369368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0d91f-151b-4f73-a558-ed63ac0026bf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:47.420506 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 915/1823] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:47 2021] POST /identity/v3/users => generated 282 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:47.428311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0d91f-151b-4f73-a558-ed63ac0026bf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:47.441494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0d91f-151b-4f73-a558-ed63ac0026bf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:47.516387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3abf-ba33-4b46-bb21-7252e081e327 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:47.522535 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23e123-159c-4dee-8fb8-9b9875510316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:47.523311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23e123-159c-4dee-8fb8-9b9875510316 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:47.523607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23e123-159c-4dee-8fb8-9b9875510316 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:47.523891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23e123-159c-4dee-8fb8-9b9875510316 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:47.524553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23e123-159c-4dee-8fb8-9b9875510316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:47.531876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142cce6-be45-452d-b5a0-5734f40bbaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:47.532498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142cce6-be45-452d-b5a0-5734f40bbaef admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:47.532781 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142cce6-be45-452d-b5a0-5734f40bbaef admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:47.533056 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142cce6-be45-452d-b5a0-5734f40bbaef admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:47.533770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142cce6-be45-452d-b5a0-5734f40bbaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:47.563162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142cce6-be45-452d-b5a0-5734f40bbaef admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:47.568526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23e123-159c-4dee-8fb8-9b9875510316 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:47.575010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 916/1824] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:47 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:47.581383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142cce6-be45-452d-b5a0-5734f40bbaef admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:47.605054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142cce6-be45-452d-b5a0-5734f40bbaef admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:47.611460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64d0b-2523-4eb5-bf3b-b74572975e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:47.612560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64d0b-2523-4eb5-bf3b-b74572975e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:47.612848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64d0b-2523-4eb5-bf3b-b74572975e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:47.614192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64d0b-2523-4eb5-bf3b-b74572975e32 admin admin] PATH_INFO: `/v3/projects/fdd9ee565477467b8067fc00b6637844/users/668e135d9ce34cbca14aecc866b42ec7/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:47.622516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 909/1825] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:47 2021] POST /identity/v3/users => generated 301 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:47.630641 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23e123-159c-4dee-8fb8-9b9875510316 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:47.638859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac64d0b-2523-4eb5-bf3b-b74572975e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd9ee565477467b8067fc00b6637844, user_id=668e135d9ce34cbca14aecc866b42ec7, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:47.653750 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23e123-159c-4dee-8fb8-9b9875510316 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:47.662082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb75175-b38e-40a2-8324-8e1c1f313624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:47.663164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb75175-b38e-40a2-8324-8e1c1f313624 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:47.663676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb75175-b38e-40a2-8324-8e1c1f313624 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:47.664179 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb75175-b38e-40a2-8324-8e1c1f313624 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:47.665913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb75175-b38e-40a2-8324-8e1c1f313624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:47.666839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac64d0b-2523-4eb5-bf3b-b74572975e32 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:47.689811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 917/1826] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:47 2021] PUT /identity/v3/projects/fdd9ee565477467b8067fc00b6637844/users/668e135d9ce34cbca14aecc866b42ec7/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:47.702849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64d0b-2523-4eb5-bf3b-b74572975e32 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:47.708087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4ac64d0b-2523-4eb5-bf3b-b74572975e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:47.732083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb75175-b38e-40a2-8324-8e1c1f313624 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:47.755417 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 910/1827] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:47 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:47.757700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af6e68-4a9f-43ff-9996-deb9d19776eb None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:47.758271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af6e68-4a9f-43ff-9996-deb9d19776eb None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:47.758688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af6e68-4a9f-43ff-9996-deb9d19776eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:47.802637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64d0b-2523-4eb5-bf3b-b74572975e32 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:47.807523 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:47.808365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:47.808651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:47.808930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] PATH_INFO: `/v3/projects/0284b9eb80f94b20b79fff196372f50a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:47.810375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0284b9eb80f94b20b79fff196372f50a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:47.829035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-15af6e68-4a9f-43ff-9996-deb9d19776eb None None] MFA Rules not processed for user `668e135d9ce34cbca14aecc866b42ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:47.831061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-15af6e68-4a9f-43ff-9996-deb9d19776eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:47.836460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:47.899426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0284b9eb80f94b20b79fff196372f50a', 'request_id': 'req-8c0f5ec0-26c3-4e38-a41d-7980c0003524'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:47.913349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0284b9eb80f94b20b79fff196372f50a', 'request_id': 'req-8c0f5ec0-26c3-4e38-a41d-7980c0003524'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:47.929105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0284b9eb80f94b20b79fff196372f50a', 'request_id': 'req-8c0f5ec0-26c3-4e38-a41d-7980c0003524'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:47.942636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] The token cache is being invalidate because project 0284b9eb80f94b20b79fff196372f50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:47.942925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:47.943762 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:47.951815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 918/1828] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:47 2021] DELETE /identity/v3/projects/0284b9eb80f94b20b79fff196372f50a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:47.952996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:47.954492 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:47.997834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 911/1829] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:47 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:48.000839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633a20d-35ac-4242-982b-2672bd0df949 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.001521 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633a20d-35ac-4242-982b-2672bd0df949 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.001801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633a20d-35ac-4242-982b-2672bd0df949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.050828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c633a20d-35ac-4242-982b-2672bd0df949 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:48.052466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c633a20d-35ac-4242-982b-2672bd0df949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:48.061613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 912/1830] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:48.062840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633a20d-35ac-4242-982b-2672bd0df949 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.064279 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c633a20d-35ac-4242-982b-2672bd0df949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:48.081077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633a20d-35ac-4242-982b-2672bd0df949 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.086083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f5ec0-26c3-4e38-a41d-7980c0003524 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.087492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03de41-b359-4b50-9ba3-d44204455b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.088283 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03de41-b359-4b50-9ba3-d44204455b85 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.089533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03de41-b359-4b50-9ba3-d44204455b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.089533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03de41-b359-4b50-9ba3-d44204455b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.089811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03de41-b359-4b50-9ba3-d44204455b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.093267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970e26-6310-4430-a202-da4b9cbcff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.094915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970e26-6310-4430-a202-da4b9cbcff9a admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.095573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970e26-6310-4430-a202-da4b9cbcff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.096035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970e26-6310-4430-a202-da4b9cbcff9a admin admin] PATH_INFO: `/v3/projects/ac6d3276e83c4bed89566bdcf21b6408/users/280b6297ebff43d7b24841f2ab33bc61/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.120217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03de41-b359-4b50-9ba3-d44204455b85 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:48.151280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03970e26-6310-4430-a202-da4b9cbcff9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6d3276e83c4bed89566bdcf21b6408, user_id=280b6297ebff43d7b24841f2ab33bc61, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.166410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 913/1831] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:48 2021] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:48.172153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84787b24-bf7c-4ec4-bbfb-b05fa7620afe None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.172445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84787b24-bf7c-4ec4-bbfb-b05fa7620afe None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.172724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84787b24-bf7c-4ec4-bbfb-b05fa7620afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.204749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03970e26-6310-4430-a202-da4b9cbcff9a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:48.233624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 919/1832] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:47 2021] PUT /identity/v3/projects/ac6d3276e83c4bed89566bdcf21b6408/users/280b6297ebff43d7b24841f2ab33bc61/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:48.235111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970e26-6310-4430-a202-da4b9cbcff9a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.235336 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-84787b24-bf7c-4ec4-bbfb-b05fa7620afe None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:48.237226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-84787b24-bf7c-4ec4-bbfb-b05fa7620afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:48.360939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970e26-6310-4430-a202-da4b9cbcff9a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.366051 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781a76-176e-43e5-8a1b-a4527041325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.367016 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781a76-176e-43e5-8a1b-a4527041325e admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.367303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781a76-176e-43e5-8a1b-a4527041325e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.367934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781a76-176e-43e5-8a1b-a4527041325e admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.368259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781a76-176e-43e5-8a1b-a4527041325e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.389569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 914/1833] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:48.391313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84787b24-bf7c-4ec4-bbfb-b05fa7620afe None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.402287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781a76-176e-43e5-8a1b-a4527041325e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:48.409583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84787b24-bf7c-4ec4-bbfb-b05fa7620afe None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.419351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc9c27-8fec-4c81-a2a8-66d29db1816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.420814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc9c27-8fec-4c81-a2a8-66d29db1816c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.422431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc9c27-8fec-4c81-a2a8-66d29db1816c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.423011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc9c27-8fec-4c81-a2a8-66d29db1816c admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.424918 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc9c27-8fec-4c81-a2a8-66d29db1816c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.436775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 920/1834] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:48 2021] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:48.436775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781a76-176e-43e5-8a1b-a4527041325e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.451568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781a76-176e-43e5-8a1b-a4527041325e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.457593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb5175-8cb8-4a74-86be-dc5c30fc7a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.459846 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb5175-8cb8-4a74-86be-dc5c30fc7a01 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.460251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb5175-8cb8-4a74-86be-dc5c30fc7a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.460688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb5175-8cb8-4a74-86be-dc5c30fc7a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.461789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb5175-8cb8-4a74-86be-dc5c30fc7a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:48.463769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb5175-8cb8-4a74-86be-dc5c30fc7a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.482536 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc9c27-8fec-4c81-a2a8-66d29db1816c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:48.508187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 915/1835] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:48.511922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc9c27-8fec-4c81-a2a8-66d29db1816c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.528743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc9c27-8fec-4c81-a2a8-66d29db1816c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.531624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb5175-8cb8-4a74-86be-dc5c30fc7a01 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:48.536455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7d0b8-2894-490e-8665-52576d0b6df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.537736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7d0b8-2894-490e-8665-52576d0b6df9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.538510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7d0b8-2894-490e-8665-52576d0b6df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.539176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7d0b8-2894-490e-8665-52576d0b6df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.540674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7d0b8-2894-490e-8665-52576d0b6df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.561436 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 921/1836] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:38:48.562779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb5175-8cb8-4a74-86be-dc5c30fc7a01 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.583848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb5175-8cb8-4a74-86be-dc5c30fc7a01 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.586022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7d0b8-2894-490e-8665-52576d0b6df9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:48.592404 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112be7-9bf3-4368-b333-ae031b2dbfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.594411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112be7-9bf3-4368-b333-ae031b2dbfca admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.595285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112be7-9bf3-4368-b333-ae031b2dbfca admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.595871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112be7-9bf3-4368-b333-ae031b2dbfca admin admin] PATH_INFO: `/v3/projects/ac6d3276e83c4bed89566bdcf21b6408/users/280b6297ebff43d7b24841f2ab33bc61/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.603632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112be7-9bf3-4368-b333-ae031b2dbfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6d3276e83c4bed89566bdcf21b6408, user_id=280b6297ebff43d7b24841f2ab33bc61, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.621664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 916/1837] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:48.623371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7d0b8-2894-490e-8665-52576d0b6df9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.643906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7d0b8-2894-490e-8665-52576d0b6df9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.651743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148f361-4ae9-45d3-b19c-52103602e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.652662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148f361-4ae9-45d3-b19c-52103602e00a admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.653084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148f361-4ae9-45d3-b19c-52103602e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.653569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148f361-4ae9-45d3-b19c-52103602e00a admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.654796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148f361-4ae9-45d3-b19c-52103602e00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.667944 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112be7-9bf3-4368-b333-ae031b2dbfca admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:48.696445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 922/1838] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:48 2021] PUT /identity/v3/projects/ac6d3276e83c4bed89566bdcf21b6408/users/280b6297ebff43d7b24841f2ab33bc61/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:48.698169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112be7-9bf3-4368-b333-ae031b2dbfca admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.699968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148f361-4ae9-45d3-b19c-52103602e00a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:48.747949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 917/1839] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:48 2021] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:48.747949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148f361-4ae9-45d3-b19c-52103602e00a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.808164 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112be7-9bf3-4368-b333-ae031b2dbfca admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.898355 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148f361-4ae9-45d3-b19c-52103602e00a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.907336 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e23248-84cd-4702-9f12-8bc5dc19303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.908083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e23248-84cd-4702-9f12-8bc5dc19303f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.908568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e23248-84cd-4702-9f12-8bc5dc19303f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.909585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e23248-84cd-4702-9f12-8bc5dc19303f admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.910424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e23248-84cd-4702-9f12-8bc5dc19303f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.920350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8414b-aa59-4579-b6d2-9109c16ab151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.921841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8414b-aa59-4579-b6d2-9109c16ab151 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.922797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8414b-aa59-4579-b6d2-9109c16ab151 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.923297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8414b-aa59-4579-b6d2-9109c16ab151 admin admin] PATH_INFO: `/v3/projects/1fab2deb6e4b49458ce787b11e3c9b64/users/0665561f917a4b578b31c1f16c93f81d/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.941840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e23248-84cd-4702-9f12-8bc5dc19303f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:48.959777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 918/1840] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:48.959777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e23248-84cd-4702-9f12-8bc5dc19303f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:48.962578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8414b-aa59-4579-b6d2-9109c16ab151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fab2deb6e4b49458ce787b11e3c9b64, user_id=0665561f917a4b578b31c1f16c93f81d, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.972265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e23248-84cd-4702-9f12-8bc5dc19303f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:48.979626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54ed57-25da-43cb-837c-b2a5e4a76465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:48.980376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54ed57-25da-43cb-837c-b2a5e4a76465 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:48.980884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54ed57-25da-43cb-837c-b2a5e4a76465 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:48.981238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54ed57-25da-43cb-837c-b2a5e4a76465 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:48.982045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54ed57-25da-43cb-837c-b2a5e4a76465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:48.998921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8414b-aa59-4579-b6d2-9109c16ab151 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:49.016663 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 923/1841] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:48 2021] PUT /identity/v3/projects/1fab2deb6e4b49458ce787b11e3c9b64/users/0665561f917a4b578b31c1f16c93f81d/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:49.017562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54ed57-25da-43cb-837c-b2a5e4a76465 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:49.018387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8414b-aa59-4579-b6d2-9109c16ab151 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:49.057309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 919/1842] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:48 2021] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:49.057309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54ed57-25da-43cb-837c-b2a5e4a76465 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:49.067116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54ed57-25da-43cb-837c-b2a5e4a76465 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:49.153350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8414b-aa59-4579-b6d2-9109c16ab151 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:49.158424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f534e-b14f-400e-adf6-6f351fb8ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:49.159817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f534e-b14f-400e-adf6-6f351fb8ef2a admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:49.160701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f534e-b14f-400e-adf6-6f351fb8ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:49.161030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f534e-b14f-400e-adf6-6f351fb8ef2a admin admin] PATH_INFO: `/v3/projects/ac6d3276e83c4bed89566bdcf21b6408/users/280b6297ebff43d7b24841f2ab33bc61/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:49.161658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f619d-23fe-4ae9-987c-ed09220b8d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:49.163025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f619d-23fe-4ae9-987c-ed09220b8d6c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:49.163634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f619d-23fe-4ae9-987c-ed09220b8d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:49.163808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f534e-b14f-400e-adf6-6f351fb8ef2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6d3276e83c4bed89566bdcf21b6408, user_id=280b6297ebff43d7b24841f2ab33bc61, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:49.164065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f619d-23fe-4ae9-987c-ed09220b8d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:49.164965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f619d-23fe-4ae9-987c-ed09220b8d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:49.205274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f619d-23fe-4ae9-987c-ed09220b8d6c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:49.211232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f534e-b14f-400e-adf6-6f351fb8ef2a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:49.220636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 920/1843] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:49 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:49.221780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f619d-23fe-4ae9-987c-ed09220b8d6c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:49.235005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f619d-23fe-4ae9-987c-ed09220b8d6c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:49.248147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 924/1844] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:49 2021] PUT /identity/v3/projects/ac6d3276e83c4bed89566bdcf21b6408/users/280b6297ebff43d7b24841f2ab33bc61/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:49.249481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f534e-b14f-400e-adf6-6f351fb8ef2a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:49.361039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510d096-4b99-466e-a218-5af0a3d20312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:49.362939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510d096-4b99-466e-a218-5af0a3d20312 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:49.362939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510d096-4b99-466e-a218-5af0a3d20312 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:49.363256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510d096-4b99-466e-a218-5af0a3d20312 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:49.364386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510d096-4b99-466e-a218-5af0a3d20312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:49.410583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f534e-b14f-400e-adf6-6f351fb8ef2a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:49.418957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061133-2498-43e7-baa3-c21912e77294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:49.420277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061133-2498-43e7-baa3-c21912e77294 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:49.420722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061133-2498-43e7-baa3-c21912e77294 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:49.421137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061133-2498-43e7-baa3-c21912e77294 admin admin] PATH_INFO: `/v3/projects/1fab2deb6e4b49458ce787b11e3c9b64/users/0665561f917a4b578b31c1f16c93f81d/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:49.421295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510d096-4b99-466e-a218-5af0a3d20312 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:49.423507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3061133-2498-43e7-baa3-c21912e77294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fab2deb6e4b49458ce787b11e3c9b64, user_id=0665561f917a4b578b31c1f16c93f81d, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:49.442974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 921/1845] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:49 2021] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:49.444837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c2eb-7a35-4c3e-8e68-98a148e1865d None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:49.445318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c2eb-7a35-4c3e-8e68-98a148e1865d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:49.445723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c2eb-7a35-4c3e-8e68-98a148e1865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:49.464269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3061133-2498-43e7-baa3-c21912e77294 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:49.479747 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 925/1846] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:49 2021] PUT /identity/v3/projects/1fab2deb6e4b49458ce787b11e3c9b64/users/0665561f917a4b578b31c1f16c93f81d/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:49.481307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061133-2498-43e7-baa3-c21912e77294 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:49.509567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-65f6c2eb-7a35-4c3e-8e68-98a148e1865d None None] MFA Rules not processed for user `280b6297ebff43d7b24841f2ab33bc61`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:49.511402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-65f6c2eb-7a35-4c3e-8e68-98a148e1865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:49.585285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061133-2498-43e7-baa3-c21912e77294 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:49.591393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216626-d093-46c8-b79c-a4a67f5a462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:49.592239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216626-d093-46c8-b79c-a4a67f5a462e admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:49.592524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216626-d093-46c8-b79c-a4a67f5a462e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:49.592824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86216626-d093-46c8-b79c-a4a67f5a462e admin admin] PATH_INFO: `/v3/projects/2a36d615df9e43fa86b6721df4d09359/users/56ab0269cc8d448a8cadfc68d81cdb59/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:49.624405 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86216626-d093-46c8-b79c-a4a67f5a462e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a36d615df9e43fa86b6721df4d09359, user_id=56ab0269cc8d448a8cadfc68d81cdb59, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:49.652894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 922/1847] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:49 2021] POST /identity/v3/auth/tokens => generated 3763 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:49.656237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6c2eb-7a35-4c3e-8e68-98a148e1865d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:49.669251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86216626-d093-46c8-b79c-a4a67f5a462e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:49.674775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6c2eb-7a35-4c3e-8e68-98a148e1865d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:49.684675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07518adf-8e0a-405f-915b-31c74a9c5993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:49.687911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07518adf-8e0a-405f-915b-31c74a9c5993 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:49.687911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07518adf-8e0a-405f-915b-31c74a9c5993 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:49.687911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07518adf-8e0a-405f-915b-31c74a9c5993 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:49.688831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07518adf-8e0a-405f-915b-31c74a9c5993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:49.693192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 926/1848] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:49 2021] PUT /identity/v3/projects/2a36d615df9e43fa86b6721df4d09359/users/56ab0269cc8d448a8cadfc68d81cdb59/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:49.694577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216626-d093-46c8-b79c-a4a67f5a462e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:49.698108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-86216626-d093-46c8-b79c-a4a67f5a462e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:49.746770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07518adf-8e0a-405f-915b-31c74a9c5993 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:49.764240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 923/1849] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:49 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:49.766802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d772-1364-4b77-96cd-b5d6a09e47c1 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:49.767718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d772-1364-4b77-96cd-b5d6a09e47c1 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:49.768136 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d772-1364-4b77-96cd-b5d6a09e47c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:49.819645 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86216626-d093-46c8-b79c-a4a67f5a462e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:49.825587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d7b0d772-1364-4b77-96cd-b5d6a09e47c1 None None] MFA Rules not processed for user `56ab0269cc8d448a8cadfc68d81cdb59`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:49.826945 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d7b0d772-1364-4b77-96cd-b5d6a09e47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:49.827251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c796d-96ff-415e-855c-9e27b1509a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:49.828571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c796d-96ff-415e-855c-9e27b1509a48 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:49.829275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c796d-96ff-415e-855c-9e27b1509a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:49.829943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c796d-96ff-415e-855c-9e27b1509a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:49.991210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c796d-96ff-415e-855c-9e27b1509a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:50.012167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 924/1850] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:49 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:50.013865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d772-1364-4b77-96cd-b5d6a09e47c1 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:50.046968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c796d-96ff-415e-855c-9e27b1509a48 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:50.058879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 927/1851] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:49 2021] GET /identity/v3/auth/tokens => generated 3763 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:50.059751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c796d-96ff-415e-855c-9e27b1509a48 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:50.162297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d772-1364-4b77-96cd-b5d6a09e47c1 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:50.174812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee27e0-2ecd-416e-9ce9-736d04dcf2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:50.175804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee27e0-2ecd-416e-9ce9-736d04dcf2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:50.176401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee27e0-2ecd-416e-9ce9-736d04dcf2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:50.177542 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee27e0-2ecd-416e-9ce9-736d04dcf2e8 admin admin] PATH_INFO: `/v3/projects/1fab2deb6e4b49458ce787b11e3c9b64/users/0665561f917a4b578b31c1f16c93f81d/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:50.182610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee27e0-2ecd-416e-9ce9-736d04dcf2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fab2deb6e4b49458ce787b11e3c9b64, user_id=0665561f917a4b578b31c1f16c93f81d, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:50.221769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c796d-96ff-415e-855c-9e27b1509a48 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:50.252875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee27e0-2ecd-416e-9ce9-736d04dcf2e8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:50.257381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65f34c-1c8e-455a-a8ce-fe9f4bdd0185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:50.258228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f34c-1c8e-455a-a8ce-fe9f4bdd0185 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:50.258521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f34c-1c8e-455a-a8ce-fe9f4bdd0185 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:50.258846 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f34c-1c8e-455a-a8ce-fe9f4bdd0185 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:50.259630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65f34c-1c8e-455a-a8ce-fe9f4bdd0185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:50.294358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 925/1852] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:50 2021] PUT /identity/v3/projects/1fab2deb6e4b49458ce787b11e3c9b64/users/0665561f917a4b578b31c1f16c93f81d/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:50.303157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee27e0-2ecd-416e-9ce9-736d04dcf2e8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:50.313616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65f34c-1c8e-455a-a8ce-fe9f4bdd0185 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:50.363534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 928/1853] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:50 2021] POST /identity/v3/projects => generated 385 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:50.369068 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79102-a464-4533-960c-66c7d67b6213 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:50.369448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79102-a464-4533-960c-66c7d67b6213 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:50.369582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79102-a464-4533-960c-66c7d67b6213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:50.415746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-bfd79102-a464-4533-960c-66c7d67b6213 None None] MFA Rules not processed for user `0665561f917a4b578b31c1f16c93f81d`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:50.417594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-bfd79102-a464-4533-960c-66c7d67b6213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:50.434166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee27e0-2ecd-416e-9ce9-736d04dcf2e8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:50.540054 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:50.541146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:50.541716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:50.542252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] PATH_INFO: `/v3/users/99163beb6e7f4cdb919a5a4214afcf81` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:50.544121 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99163beb6e7f4cdb919a5a4214afcf81)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:50.558472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 929/1854] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:50 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:50.560093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd79102-a464-4533-960c-66c7d67b6213 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:50.576366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:50.576983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd79102-a464-4533-960c-66c7d67b6213 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:50.585078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ce669-01a3-4250-b61e-e8646b69f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:50.585078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ce669-01a3-4250-b61e-e8646b69f035 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:50.585334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ce669-01a3-4250-b61e-e8646b69f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:50.585486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ce669-01a3-4250-b61e-e8646b69f035 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:50.586282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ce669-01a3-4250-b61e-e8646b69f035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:50.621347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ce669-01a3-4250-b61e-e8646b69f035 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:50.653197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 930/1855] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:50 2021] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:50.654505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ce669-01a3-4250-b61e-e8646b69f035 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:50.658265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5b8ce669-01a3-4250-b61e-e8646b69f035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:50.675017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99163beb6e7f4cdb919a5a4214afcf81'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:50.685910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99163beb6e7f4cdb919a5a4214afcf81'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:50.686836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99163beb6e7f4cdb919a5a4214afcf81'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:50.702760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99163beb6e7f4cdb919a5a4214afcf81'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:50.724298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99163beb6e7f4cdb919a5a4214afcf81'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:50.735462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 926/1856] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:50 2021] DELETE /identity/v3/users/99163beb6e7f4cdb919a5a4214afcf81 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:50.738654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:50.738654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:50.778291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ce669-01a3-4250-b61e-e8646b69f035 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:50.836290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de2af-a430-4468-9b85-80dba81923f1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:50.845922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4c85b-ef0c-42cd-9017-2dc363e76d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:50.847056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4c85b-ef0c-42cd-9017-2dc363e76d48 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:50.847570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4c85b-ef0c-42cd-9017-2dc363e76d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:50.848079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4c85b-ef0c-42cd-9017-2dc363e76d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:50.849444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4c85b-ef0c-42cd-9017-2dc363e76d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:50.851437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:50.852075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:50.852359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:50.852636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:50.855259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:50.892405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4c85b-ef0c-42cd-9017-2dc363e76d48 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:50.904258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 927/1857] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:50 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:50.905560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e46cf-d7d2-4d5e-ae2f-7bdfda733cff None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:50.905852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e46cf-d7d2-4d5e-ae2f-7bdfda733cff None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:50.906167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e46cf-d7d2-4d5e-ae2f-7bdfda733cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:50.929896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-155e46cf-d7d2-4d5e-ae2f-7bdfda733cff None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:50.931193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-155e46cf-d7d2-4d5e-ae2f-7bdfda733cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:50.940574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 928/1858] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:50.941473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e46cf-d7d2-4d5e-ae2f-7bdfda733cff None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:50.950799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:50.956851 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e46cf-d7d2-4d5e-ae2f-7bdfda733cff None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:50.961518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f5b8e-34c9-4f42-9d95-03aab469224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:50.962391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f5b8e-34c9-4f42-9d95-03aab469224e admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:50.962944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f5b8e-34c9-4f42-9d95-03aab469224e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:50.962944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f5b8e-34c9-4f42-9d95-03aab469224e admin admin] PATH_INFO: `/v3/projects/201be88f3ca1435081c52fdfd4f966c8/users/264f96981ff1460b8f9c22af17c7f315/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:50.978695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:50.991403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 931/1859] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:50 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:50.993003 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:50.993136 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f5b8e-34c9-4f42-9d95-03aab469224e admin admin] RBAC: Authorizing `identity:create_grant(project_id=201be88f3ca1435081c52fdfd4f966c8, user_id=264f96981ff1460b8f9c22af17c7f315, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:50.995352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:51.020770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f5b8e-34c9-4f42-9d95-03aab469224e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:51.041965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 929/1860] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:50 2021] PUT /identity/v3/projects/201be88f3ca1435081c52fdfd4f966c8/users/264f96981ff1460b8f9c22af17c7f315/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:51.043365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f5b8e-34c9-4f42-9d95-03aab469224e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:51.088221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f388-1fbd-4e45-88fb-5297ed9139f6 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:51.187210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f5b8e-34c9-4f42-9d95-03aab469224e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:51.195036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6138bd-66ab-4287-8faa-e154c074d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:51.196127 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6138bd-66ab-4287-8faa-e154c074d1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:51.196638 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6138bd-66ab-4287-8faa-e154c074d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:51.198426 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6138bd-66ab-4287-8faa-e154c074d1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:51.199631 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6138bd-66ab-4287-8faa-e154c074d1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:51.212791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e22dc-7533-47a4-97eb-57effcfea9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:51.213479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e22dc-7533-47a4-97eb-57effcfea9cd service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:51.213822 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e22dc-7533-47a4-97eb-57effcfea9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:51.214309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e22dc-7533-47a4-97eb-57effcfea9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:51.224870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e22dc-7533-47a4-97eb-57effcfea9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:51.243149 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6138bd-66ab-4287-8faa-e154c074d1e9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:51.252031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e22dc-7533-47a4-97eb-57effcfea9cd service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:51.264240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 930/1861] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:51 2021] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:51.264240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6138bd-66ab-4287-8faa-e154c074d1e9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:51.265385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-da6138bd-66ab-4287-8faa-e154c074d1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:51.270303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 932/1862] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:51.271842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e22dc-7533-47a4-97eb-57effcfea9cd service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:51.283327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e22dc-7533-47a4-97eb-57effcfea9cd service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:51.289538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bf1be-6afa-4316-a89e-583409908fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:51.290927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bf1be-6afa-4316-a89e-583409908fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:51.291618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bf1be-6afa-4316-a89e-583409908fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:51.292148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bf1be-6afa-4316-a89e-583409908fdb admin admin] PATH_INFO: `/v3/projects/201be88f3ca1435081c52fdfd4f966c8/users/264f96981ff1460b8f9c22af17c7f315/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:51.294545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bf1be-6afa-4316-a89e-583409908fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=201be88f3ca1435081c52fdfd4f966c8, user_id=264f96981ff1460b8f9c22af17c7f315, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:51.326359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bf1be-6afa-4316-a89e-583409908fdb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:51.339796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 933/1863] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:51 2021] PUT /identity/v3/projects/201be88f3ca1435081c52fdfd4f966c8/users/264f96981ff1460b8f9c22af17c7f315/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:51.346770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bf1be-6afa-4316-a89e-583409908fdb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:51.359330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6138bd-66ab-4287-8faa-e154c074d1e9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:51.446655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508adc-f71a-46af-b80b-dff59deea37d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:51.447347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508adc-f71a-46af-b80b-dff59deea37d service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:51.447690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508adc-f71a-46af-b80b-dff59deea37d service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:51.447989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508adc-f71a-46af-b80b-dff59deea37d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:51.450290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-61508adc-f71a-46af-b80b-dff59deea37d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:51.550340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61508adc-f71a-46af-b80b-dff59deea37d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:51.565444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bf1be-6afa-4316-a89e-583409908fdb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:51.571482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97827bec-6a9b-43b1-bde6-06bec8b9e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:51.572743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97827bec-6a9b-43b1-bde6-06bec8b9e256 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:51.573181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97827bec-6a9b-43b1-bde6-06bec8b9e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:51.573502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97827bec-6a9b-43b1-bde6-06bec8b9e256 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:51.574284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97827bec-6a9b-43b1-bde6-06bec8b9e256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:51.584865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61508adc-f71a-46af-b80b-dff59deea37d service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:51.607869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97827bec-6a9b-43b1-bde6-06bec8b9e256 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:51.608469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 931/1864] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:51 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:51.620414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 934/1865] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:51 2021] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:51.624895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508adc-f71a-46af-b80b-dff59deea37d service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:51.637937 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508adc-f71a-46af-b80b-dff59deea37d service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:51.642890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f468e04-8320-48b0-9b45-c92d35c5d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:51.643608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f468e04-8320-48b0-9b45-c92d35c5d30d admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:51.643893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f468e04-8320-48b0-9b45-c92d35c5d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:51.644176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f468e04-8320-48b0-9b45-c92d35c5d30d admin admin] PATH_INFO: `/v3/projects/201be88f3ca1435081c52fdfd4f966c8/users/264f96981ff1460b8f9c22af17c7f315/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:51.646995 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f468e04-8320-48b0-9b45-c92d35c5d30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=201be88f3ca1435081c52fdfd4f966c8, user_id=264f96981ff1460b8f9c22af17c7f315, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:51.675695 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f468e04-8320-48b0-9b45-c92d35c5d30d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:51.709133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf6e8-ca7f-469c-9f3c-ff51d1a73686 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:51.709497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf6e8-ca7f-469c-9f3c-ff51d1a73686 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:51.709714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf6e8-ca7f-469c-9f3c-ff51d1a73686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:51.712027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 932/1866] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:51 2021] PUT /identity/v3/projects/201be88f3ca1435081c52fdfd4f966c8/users/264f96981ff1460b8f9c22af17c7f315/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:38:51.760023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-07acf6e8-ca7f-469c-9f3c-ff51d1a73686 None None] MFA Rules not processed for user `264f96981ff1460b8f9c22af17c7f315`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:51.761581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-07acf6e8-ca7f-469c-9f3c-ff51d1a73686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:51.944433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 935/1867] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:51 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:51.955972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f468e04-8320-48b0-9b45-c92d35c5d30d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:52.125919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f468e04-8320-48b0-9b45-c92d35c5d30d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:52.130681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2c13-a132-46e8-a31b-09a5eb147eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:52.131478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2c13-a132-46e8-a31b-09a5eb147eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:52.131864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2c13-a132-46e8-a31b-09a5eb147eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:52.132270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2c13-a132-46e8-a31b-09a5eb147eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:52.154870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b2c13-a132-46e8-a31b-09a5eb147eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:52.183519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b2c13-a132-46e8-a31b-09a5eb147eb9 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:52.194266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 933/1868] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:51 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:52.361036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acf6e8-ca7f-469c-9f3c-ff51d1a73686 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:52.363167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-07acf6e8-ca7f-469c-9f3c-ff51d1a73686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:52.478514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acf6e8-ca7f-469c-9f3c-ff51d1a73686 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:52.483489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:52.484682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:52.485045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:52.485398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] PATH_INFO: `/v3/projects/c0c884cdc1bd4510afae9792e723e566` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:52.486751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c884cdc1bd4510afae9792e723e566)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:52.516146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:52.586928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c884cdc1bd4510afae9792e723e566', 'request_id': 'req-090c6d18-341f-4a59-b51c-1f95bc722300'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:52.609446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c884cdc1bd4510afae9792e723e566', 'request_id': 'req-090c6d18-341f-4a59-b51c-1f95bc722300'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:52.631039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c884cdc1bd4510afae9792e723e566', 'request_id': 'req-090c6d18-341f-4a59-b51c-1f95bc722300'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:52.656469 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] The token cache is being invalidate because project c0c884cdc1bd4510afae9792e723e566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:52.656675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:52.658361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:52.661772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 936/1869] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:52 2021] DELETE /identity/v3/projects/c0c884cdc1bd4510afae9792e723e566 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:52.671360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2c13-a132-46e8-a31b-09a5eb147eb9 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:52.686914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2c13-a132-46e8-a31b-09a5eb147eb9 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:52.891195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:52.892867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:52.898629 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:52.899015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] PATH_INFO: `/v3/users/280b6297ebff43d7b24841f2ab33bc61` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:52.903172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280b6297ebff43d7b24841f2ab33bc61)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:52.974288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:53.164792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280b6297ebff43d7b24841f2ab33bc61'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:53.180698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280b6297ebff43d7b24841f2ab33bc61'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:53.182054 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280b6297ebff43d7b24841f2ab33bc61'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:53.213280 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280b6297ebff43d7b24841f2ab33bc61'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:53.261563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280b6297ebff43d7b24841f2ab33bc61'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:53.283357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 934/1870] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:52 2021] DELETE /identity/v3/users/280b6297ebff43d7b24841f2ab33bc61 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:53.742416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:53.747161 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:53.793001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c6d18-341f-4a59-b51c-1f95bc722300 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:53.908459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:53.909310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:53.909603 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:53.910377 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] PATH_INFO: `/v3/users/56ab0269cc8d448a8cadfc68d81cdb59` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:53.911782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ab0269cc8d448a8cadfc68d81cdb59)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:53.939647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:53.999309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:54.001746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:54.023528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e206f-020c-4306-b794-297fd4f165e9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:54.031412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:54.032247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.032534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.032815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] PATH_INFO: `/v3/projects/ac6d3276e83c4bed89566bdcf21b6408` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:54.034109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac6d3276e83c4bed89566bdcf21b6408)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:54.044815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ab0269cc8d448a8cadfc68d81cdb59'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.064211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:54.064966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ab0269cc8d448a8cadfc68d81cdb59'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.085155 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ab0269cc8d448a8cadfc68d81cdb59'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.086069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ab0269cc8d448a8cadfc68d81cdb59'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.106784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-edaca4eb-301f-416e-a2a3-acdc1dad22d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ab0269cc8d448a8cadfc68d81cdb59'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.130117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 937/1871] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:53 2021] DELETE /identity/v3/users/56ab0269cc8d448a8cadfc68d81cdb59 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:54.138907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a64194-8477-470c-a5d2-1f4d1b76685e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.139365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a64194-8477-470c-a5d2-1f4d1b76685e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.139738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a64194-8477-470c-a5d2-1f4d1b76685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:54.165207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac6d3276e83c4bed89566bdcf21b6408', 'request_id': 'req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.194546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-98a64194-8477-470c-a5d2-1f4d1b76685e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:54.197062 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-98a64194-8477-470c-a5d2-1f4d1b76685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:54.208496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac6d3276e83c4bed89566bdcf21b6408', 'request_id': 'req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.223371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac6d3276e83c4bed89566bdcf21b6408', 'request_id': 'req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.243727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] The token cache is being invalidate because project ac6d3276e83c4bed89566bdcf21b6408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:54.244320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.258514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f0c3fc2a-29a0-4a84-bc01-1de1f911c652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:54.265422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 935/1872] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:53 2021] DELETE /identity/v3/projects/ac6d3276e83c4bed89566bdcf21b6408 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:54.267728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab7464-ccab-49b6-9d43-7bec86265467 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.268022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab7464-ccab-49b6-9d43-7bec86265467 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.268306 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab7464-ccab-49b6-9d43-7bec86265467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:54.297708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-bdab7464-ccab-49b6-9d43-7bec86265467 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:54.298207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 938/1873] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:54.298956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-bdab7464-ccab-49b6-9d43-7bec86265467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:54.308108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a64194-8477-470c-a5d2-1f4d1b76685e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:54.309493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-98a64194-8477-470c-a5d2-1f4d1b76685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:54.309879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 936/1874] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:54.318746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8424afd-ac6e-4547-bb5e-9ee9626bc0d2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.319089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8424afd-ac6e-4547-bb5e-9ee9626bc0d2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.319307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8424afd-ac6e-4547-bb5e-9ee9626bc0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:54.348300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c8424afd-ac6e-4547-bb5e-9ee9626bc0d2 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:54.350206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c8424afd-ac6e-4547-bb5e-9ee9626bc0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:54.362899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 937/1875] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:54.370434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8424afd-ac6e-4547-bb5e-9ee9626bc0d2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:54.385067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8424afd-ac6e-4547-bb5e-9ee9626bc0d2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:54.388044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a64194-8477-470c-a5d2-1f4d1b76685e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:54.392737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dcaeb-aaf4-44ab-ba91-c2559604abfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:54.393357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dcaeb-aaf4-44ab-ba91-c2559604abfb service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.394374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784adb1e-eba1-4831-b7f1-804786442a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:54.394988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784adb1e-eba1-4831-b7f1-804786442a28 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.395266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784adb1e-eba1-4831-b7f1-804786442a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.395533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784adb1e-eba1-4831-b7f1-804786442a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:54.396235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784adb1e-eba1-4831-b7f1-804786442a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:54.396803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dcaeb-aaf4-44ab-ba91-c2559604abfb service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.397036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dcaeb-aaf4-44ab-ba91-c2559604abfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:54.397716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784adb1e-eba1-4831-b7f1-804786442a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:54.424181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dcaeb-aaf4-44ab-ba91-c2559604abfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:54.430201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784adb1e-eba1-4831-b7f1-804786442a28 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:54.453398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 938/1876] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:38:54.454636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784adb1e-eba1-4831-b7f1-804786442a28 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:54.469056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784adb1e-eba1-4831-b7f1-804786442a28 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:54.475090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dcaeb-aaf4-44ab-ba91-c2559604abfb service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:54.475381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64856-4efe-4965-87e6-d74da33ac171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:54.476081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64856-4efe-4965-87e6-d74da33ac171 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.476433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64856-4efe-4965-87e6-d74da33ac171 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.476776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64856-4efe-4965-87e6-d74da33ac171 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:54.477511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab64856-4efe-4965-87e6-d74da33ac171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:54.496981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 939/1877] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:38:54.507144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab64856-4efe-4965-87e6-d74da33ac171 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:54.554142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 939/1878] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:54 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:38:54.555484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dcaeb-aaf4-44ab-ba91-c2559604abfb service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:54.569813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dcaeb-aaf4-44ab-ba91-c2559604abfb service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:54.699685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50829a-0267-415e-bd40-b57603400f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:54.700661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50829a-0267-415e-bd40-b57603400f48 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.701277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50829a-0267-415e-bd40-b57603400f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.702104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50829a-0267-415e-bd40-b57603400f48 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:54.703655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50829a-0267-415e-bd40-b57603400f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:54.755648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50829a-0267-415e-bd40-b57603400f48 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:54.792742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 940/1879] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:54 2021] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:38:54.798895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64856-4efe-4965-87e6-d74da33ac171 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:54.814275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64856-4efe-4965-87e6-d74da33ac171 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:54.824682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2ca93-ce90-4df1-ac16-db4df4c5dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:54.825925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2ca93-ce90-4df1-ac16-db4df4c5dba7 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.826580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2ca93-ce90-4df1-ac16-db4df4c5dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.827168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2ca93-ce90-4df1-ac16-db4df4c5dba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:54.830179 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2ca93-ce90-4df1-ac16-db4df4c5dba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:54.912759 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2ca93-ce90-4df1-ac16-db4df4c5dba7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:54.935898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 940/1880] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:54 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:54.943867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50829a-0267-415e-bd40-b57603400f48 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:54.967728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50829a-0267-415e-bd40-b57603400f48 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:54.979739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87772b7a-23ae-4ada-98c9-4e3bc060fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:54.981554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87772b7a-23ae-4ada-98c9-4e3bc060fccf admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:54.982244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87772b7a-23ae-4ada-98c9-4e3bc060fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:54.982886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87772b7a-23ae-4ada-98c9-4e3bc060fccf admin admin] PATH_INFO: `/v3/projects/1e19c76d2a7047e68d1907148a847dc1/users/0edfe474d2354005b2d78f81cedd12ac/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:55.013950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87772b7a-23ae-4ada-98c9-4e3bc060fccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e19c76d2a7047e68d1907148a847dc1, user_id=0edfe474d2354005b2d78f81cedd12ac, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:55.060727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87772b7a-23ae-4ada-98c9-4e3bc060fccf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:55.097485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 941/1881] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:54 2021] PUT /identity/v3/projects/1e19c76d2a7047e68d1907148a847dc1/users/0edfe474d2354005b2d78f81cedd12ac/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:55.104793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547827b4-b866-40bb-b73b-1dc66ef9c9e8 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:55.105860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547827b4-b866-40bb-b73b-1dc66ef9c9e8 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:55.106422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547827b4-b866-40bb-b73b-1dc66ef9c9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:55.158255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-547827b4-b866-40bb-b73b-1dc66ef9c9e8 None None] MFA Rules not processed for user `0edfe474d2354005b2d78f81cedd12ac`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:55.159901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-547827b4-b866-40bb-b73b-1dc66ef9c9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:55.437348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 941/1882] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:55 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:55.440175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87772b7a-23ae-4ada-98c9-4e3bc060fccf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:55.723134 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547827b4-b866-40bb-b73b-1dc66ef9c9e8 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:55.727719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-547827b4-b866-40bb-b73b-1dc66ef9c9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:55.760965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87772b7a-23ae-4ada-98c9-4e3bc060fccf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:55.773237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5122e72-401d-4878-8562-123e55a3e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:55.774127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5122e72-401d-4878-8562-123e55a3e0aa admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:55.774486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5122e72-401d-4878-8562-123e55a3e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:55.774840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5122e72-401d-4878-8562-123e55a3e0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:55.776091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5122e72-401d-4878-8562-123e55a3e0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:55.801409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547827b4-b866-40bb-b73b-1dc66ef9c9e8 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:55.807714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5122e72-401d-4878-8562-123e55a3e0aa admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:55.824273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:55.825839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:55.826395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:55.826897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] PATH_INFO: `/v3/projects/2a36d615df9e43fa86b6721df4d09359` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:55.835556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a36d615df9e43fa86b6721df4d09359)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:55.852984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 942/1883] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:55 2021] POST /identity/v3/projects => generated 379 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:55.857208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5122e72-401d-4878-8562-123e55a3e0aa admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:55.968339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5122e72-401d-4878-8562-123e55a3e0aa admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:55.976524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683b1c2-b264-42d0-9133-068223fff7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:55.977895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683b1c2-b264-42d0-9133-068223fff7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:55.978328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683b1c2-b264-42d0-9133-068223fff7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:55.978793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683b1c2-b264-42d0-9133-068223fff7f0 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:55.979697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683b1c2-b264-42d0-9133-068223fff7f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:56.012373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683b1c2-b264-42d0-9133-068223fff7f0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:56.029525 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:56.052467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 943/1884] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:55 2021] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:56.058960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683b1c2-b264-42d0-9133-068223fff7f0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:56.075225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683b1c2-b264-42d0-9133-068223fff7f0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:56.107497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1b8bb-a90d-4ec0-ac4b-2f6425c4ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:56.108923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1b8bb-a90d-4ec0-ac4b-2f6425c4ba90 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:56.109424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1b8bb-a90d-4ec0-ac4b-2f6425c4ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:56.111664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1b8bb-a90d-4ec0-ac4b-2f6425c4ba90 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:56.114544 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1b8bb-a90d-4ec0-ac4b-2f6425c4ba90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:56.148030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a36d615df9e43fa86b6721df4d09359', 'request_id': 'req-1aa2fb66-2a13-4723-8510-dc3318c5478c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.162881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a36d615df9e43fa86b6721df4d09359', 'request_id': 'req-1aa2fb66-2a13-4723-8510-dc3318c5478c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.177794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a36d615df9e43fa86b6721df4d09359', 'request_id': 'req-1aa2fb66-2a13-4723-8510-dc3318c5478c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.205289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] The token cache is being invalidate because project 2a36d615df9e43fa86b6721df4d09359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:56.207796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1b8bb-a90d-4ec0-ac4b-2f6425c4ba90 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:56.209491 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.212980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.218235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 942/1885] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:55 2021] DELETE /identity/v3/projects/2a36d615df9e43fa86b6721df4d09359 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:56.223391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:56.226785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:56.234032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 944/1886] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:56 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:56.239669 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1b8bb-a90d-4ec0-ac4b-2f6425c4ba90 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:56.242698 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6cb1b8bb-a90d-4ec0-ac4b-2f6425c4ba90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:56.268535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1b8bb-a90d-4ec0-ac4b-2f6425c4ba90 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:56.420123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2fb66-2a13-4723-8510-dc3318c5478c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:56.427000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:56.428348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:56.428834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:56.429312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] PATH_INFO: `/v3/users/264f96981ff1460b8f9c22af17c7f315` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:56.431539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264f96981ff1460b8f9c22af17c7f315)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:56.441267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2111d-2022-4853-8ee7-2c1673ad6e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:56.443117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2111d-2022-4853-8ee7-2c1673ad6e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:56.443571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2111d-2022-4853-8ee7-2c1673ad6e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:56.444043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2111d-2022-4853-8ee7-2c1673ad6e2e admin admin] PATH_INFO: `/v3/projects/b548c05dc8f9493598d970db05227edb/users/4bbb2c68a33d4a239f1fa18826e7a427/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:56.487139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:56.493159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2111d-2022-4853-8ee7-2c1673ad6e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b548c05dc8f9493598d970db05227edb, user_id=4bbb2c68a33d4a239f1fa18826e7a427, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:56.536373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2111d-2022-4853-8ee7-2c1673ad6e2e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:56.558651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 945/1887] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:56 2021] PUT /identity/v3/projects/b548c05dc8f9493598d970db05227edb/users/4bbb2c68a33d4a239f1fa18826e7a427/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:56.566158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2111d-2022-4853-8ee7-2c1673ad6e2e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:56.625930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264f96981ff1460b8f9c22af17c7f315'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.663242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264f96981ff1460b8f9c22af17c7f315'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.664286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264f96981ff1460b8f9c22af17c7f315'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.700188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264f96981ff1460b8f9c22af17c7f315'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.757053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264f96981ff1460b8f9c22af17c7f315'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:56.776171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2111d-2022-4853-8ee7-2c1673ad6e2e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:56.784390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 943/1888] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:56 2021] DELETE /identity/v3/users/264f96981ff1460b8f9c22af17c7f315 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:56.827484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:56.829588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:56.947301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3d4f0-6391-4193-9767-3bbe2e1a73c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:56.948590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3d4f0-6391-4193-9767-3bbe2e1a73c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:56.950431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3d4f0-6391-4193-9767-3bbe2e1a73c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:56.951369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3d4f0-6391-4193-9767-3bbe2e1a73c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:56.955202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3d4f0-6391-4193-9767-3bbe2e1a73c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:57.039896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3d4f0-6391-4193-9767-3bbe2e1a73c4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:57.041621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb66959-6cb6-4489-a559-6f948362a878 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:57.048942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:57.050100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:57.050517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:57.050900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] PATH_INFO: `/v3/users/8eefa2f6a3f845c29ab1dcf3d04da383` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:57.052771 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eefa2f6a3f845c29ab1dcf3d04da383)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:57.085933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 946/1889] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:56 2021] GET /identity/v3/roles => generated 1420 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:57.094094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3d4f0-6391-4193-9767-3bbe2e1a73c4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:57.100394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-aed3d4f0-6391-4193-9767-3bbe2e1a73c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:57.103183 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:57.154849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3d4f0-6391-4193-9767-3bbe2e1a73c4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:57.178170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7894c09-099a-443f-97f1-960ea14042b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:57.179611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7894c09-099a-443f-97f1-960ea14042b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:57.180070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7894c09-099a-443f-97f1-960ea14042b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:57.180529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7894c09-099a-443f-97f1-960ea14042b2 admin admin] PATH_INFO: `/v3/projects/b548c05dc8f9493598d970db05227edb/users/4bbb2c68a33d4a239f1fa18826e7a427/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:57.189304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7894c09-099a-443f-97f1-960ea14042b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b548c05dc8f9493598d970db05227edb, user_id=4bbb2c68a33d4a239f1fa18826e7a427, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:57.288807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7894c09-099a-443f-97f1-960ea14042b2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:57.289569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eefa2f6a3f845c29ab1dcf3d04da383'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:57.311066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 947/1890] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:57 2021] PUT /identity/v3/projects/b548c05dc8f9493598d970db05227edb/users/4bbb2c68a33d4a239f1fa18826e7a427/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:57.317233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7894c09-099a-443f-97f1-960ea14042b2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:57.340717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eefa2f6a3f845c29ab1dcf3d04da383'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:57.343929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eefa2f6a3f845c29ab1dcf3d04da383'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:57.369619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eefa2f6a3f845c29ab1dcf3d04da383'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:57.441174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3821eee8-a306-4620-8e02-d13e971927f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eefa2f6a3f845c29ab1dcf3d04da383'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:57.462706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 944/1891] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:56 2021] DELETE /identity/v3/users/8eefa2f6a3f845c29ab1dcf3d04da383 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:57.470219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa9d4-b697-4718-acd3-f70166aa4064 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:57.471754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa9d4-b697-4718-acd3-f70166aa4064 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:57.472590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa9d4-b697-4718-acd3-f70166aa4064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:57.510693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7894c09-099a-443f-97f1-960ea14042b2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:57.532845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-463aa9d4-b697-4718-acd3-f70166aa4064 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:57.536253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-463aa9d4-b697-4718-acd3-f70166aa4064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:57.673340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33881bb-990a-47f0-b57d-4aa9dd54661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:57.674654 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33881bb-990a-47f0-b57d-4aa9dd54661e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:57.674654 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33881bb-990a-47f0-b57d-4aa9dd54661e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:57.675729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33881bb-990a-47f0-b57d-4aa9dd54661e admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:57.677180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33881bb-990a-47f0-b57d-4aa9dd54661e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:57.687189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 945/1892] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:57.700790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463aa9d4-b697-4718-acd3-f70166aa4064 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:57.703443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-463aa9d4-b697-4718-acd3-f70166aa4064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:57.719849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33881bb-990a-47f0-b57d-4aa9dd54661e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:57.734059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 948/1893] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:38:57 2021] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:38:57.739506 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33881bb-990a-47f0-b57d-4aa9dd54661e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:57.749664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f33881bb-990a-47f0-b57d-4aa9dd54661e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:57.770264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33881bb-990a-47f0-b57d-4aa9dd54661e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:57.783756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58340e-1d9b-4213-861a-a39d78396076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:57.786271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58340e-1d9b-4213-861a-a39d78396076 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:57.786619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58340e-1d9b-4213-861a-a39d78396076 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:57.786957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58340e-1d9b-4213-861a-a39d78396076 admin admin] PATH_INFO: `/v3/projects/b548c05dc8f9493598d970db05227edb/users/4bbb2c68a33d4a239f1fa18826e7a427/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:57.795458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58340e-1d9b-4213-861a-a39d78396076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b548c05dc8f9493598d970db05227edb, user_id=4bbb2c68a33d4a239f1fa18826e7a427, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:57.883666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58340e-1d9b-4213-861a-a39d78396076 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:57.906821 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463aa9d4-b697-4718-acd3-f70166aa4064 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:57.913115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99b5bc-0337-4d06-ade4-11b8063d1fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:57.913810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99b5bc-0337-4d06-ade4-11b8063d1fef service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:57.914137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99b5bc-0337-4d06-ade4-11b8063d1fef service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:57.914493 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99b5bc-0337-4d06-ade4-11b8063d1fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:57.950877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 949/1894] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:38:57 2021] PUT /identity/v3/projects/b548c05dc8f9493598d970db05227edb/users/4bbb2c68a33d4a239f1fa18826e7a427/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:57.951152 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99b5bc-0337-4d06-ade4-11b8063d1fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:57.974543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46de9f-9ed6-441c-9dc7-1bff370b423e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:57.975304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46de9f-9ed6-441c-9dc7-1bff370b423e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:57.975926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46de9f-9ed6-441c-9dc7-1bff370b423e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:57.999046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99b5bc-0337-4d06-ade4-11b8063d1fef service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:58.040258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 946/1895] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:38:58.086489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99b5bc-0337-4d06-ade4-11b8063d1fef service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:58.088182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-dd99b5bc-0337-4d06-ade4-11b8063d1fef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:58.096532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-ed46de9f-9ed6-441c-9dc7-1bff370b423e None None] MFA Rules not processed for user `4bbb2c68a33d4a239f1fa18826e7a427`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:58.098784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ed46de9f-9ed6-441c-9dc7-1bff370b423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:58.104618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99b5bc-0337-4d06-ade4-11b8063d1fef service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:58.210989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:58.212807 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:58.213439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:58.213865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] PATH_INFO: `/v3/projects/201be88f3ca1435081c52fdfd4f966c8` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:58.215951 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] RBAC: Authorizing `identity:delete_project(project_id=201be88f3ca1435081c52fdfd4f966c8)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:58.278716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:58.380434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 950/1896] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:57 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:38:58.430745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201be88f3ca1435081c52fdfd4f966c8', 'request_id': 'req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:58.468130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201be88f3ca1435081c52fdfd4f966c8', 'request_id': 'req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:58.501114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201be88f3ca1435081c52fdfd4f966c8', 'request_id': 'req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:58.529243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] The token cache is being invalidate because project 201be88f3ca1435081c52fdfd4f966c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:58.530362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:58.534781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:58.538241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 947/1897] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:58 2021] DELETE /identity/v3/projects/201be88f3ca1435081c52fdfd4f966c8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:58.548268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d87ac1-fb5b-4a02-b564-cf1dc22d8deb None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:58.548835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d87ac1-fb5b-4a02-b564-cf1dc22d8deb None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:58.549570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d87ac1-fb5b-4a02-b564-cf1dc22d8deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:58.617847 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-65d87ac1-fb5b-4a02-b564-cf1dc22d8deb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:58.621488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-65d87ac1-fb5b-4a02-b564-cf1dc22d8deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:58.666762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:58.670070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:58.920198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3b550-bfd3-49e2-a24f-59d2f9ba005e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:58.942654 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 951/1898] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:58.945915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9002d-221f-4778-a710-ed0627ff8a8b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:58.946636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:58.949490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:58.950090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:58.950517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9002d-221f-4778-a710-ed0627ff8a8b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:58.950646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:58.951282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9002d-221f-4778-a710-ed0627ff8a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:58.963471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:59.049626 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-3da9002d-221f-4778-a710-ed0627ff8a8b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:38:59.052440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3da9002d-221f-4778-a710-ed0627ff8a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:59.080961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 952/1899] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:38:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:38:59.103871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9002d-221f-4778-a710-ed0627ff8a8b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:59.131044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9002d-221f-4778-a710-ed0627ff8a8b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:59.140821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e53ead-5677-4dcc-b41b-c7072305aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:59.142446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e53ead-5677-4dcc-b41b-c7072305aa93 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:59.143233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e53ead-5677-4dcc-b41b-c7072305aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:59.144100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e53ead-5677-4dcc-b41b-c7072305aa93 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:59.145729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e53ead-5677-4dcc-b41b-c7072305aa93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:38:59.146664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e53ead-5677-4dcc-b41b-c7072305aa93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:59.204715 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e53ead-5677-4dcc-b41b-c7072305aa93 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:59.210132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:59.259633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 953/1900] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:38:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:38:59.263261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e53ead-5677-4dcc-b41b-c7072305aa93 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:59.271293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:59.282441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e53ead-5677-4dcc-b41b-c7072305aa93 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:59.290521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3112eb8-f4ab-432f-82be-674ece8c7d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:59.293475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 948/1901] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:38:58 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:38:59.294157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3112eb8-f4ab-432f-82be-674ece8c7d7e admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:59.295116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3112eb8-f4ab-432f-82be-674ece8c7d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:59.296378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3112eb8-f4ab-432f-82be-674ece8c7d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:59.298632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3112eb8-f4ab-432f-82be-674ece8c7d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:59.367578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:59.371273 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3112eb8-f4ab-432f-82be-674ece8c7d7e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:59.376238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:59.404803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e590b-e702-42d9-b00f-4941ec5e61ef service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:59.416456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:59.418197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:59.419262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:59.420132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] PATH_INFO: `/v3/projects/216e877cb3c8483eb1ec6a2b665198c8` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:59.425153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216e877cb3c8483eb1ec6a2b665198c8)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:38:59.438849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 954/1902] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:38:59 2021] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:38:59.440808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3112eb8-f4ab-432f-82be-674ece8c7d7e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:59.509341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:38:59.667177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3112eb8-f4ab-432f-82be-674ece8c7d7e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:38:59.719420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216e877cb3c8483eb1ec6a2b665198c8', 'request_id': 'req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:59.766319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216e877cb3c8483eb1ec6a2b665198c8', 'request_id': 'req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:59.776440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216e877cb3c8483eb1ec6a2b665198c8', 'request_id': 'req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:59.801966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] The token cache is being invalidate because project 216e877cb3c8483eb1ec6a2b665198c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:38:59.802984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:59.804868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:38:59.808597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 949/1903] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:38:59 2021] DELETE /identity/v3/projects/216e877cb3c8483eb1ec6a2b665198c8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:38:59.814890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:38:59.817480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:38:59.992077 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17edad9-b740-4d4c-94ae-ec4153fbb7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:38:59.993114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17edad9-b740-4d4c-94ae-ec4153fbb7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:38:59.993592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17edad9-b740-4d4c-94ae-ec4153fbb7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:38:59.994104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17edad9-b740-4d4c-94ae-ec4153fbb7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:38:59.996084 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17edad9-b740-4d4c-94ae-ec4153fbb7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:00.059224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17edad9-b740-4d4c-94ae-ec4153fbb7a3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:00.066110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196b6b3-a819-4d0c-b63e-9b9642cf19b0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:00.094352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:00.098024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:00.099960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:00.100506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] PATH_INFO: `/v3/users/88651aae02a74476843a9d968aff3361` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:00.108812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=88651aae02a74476843a9d968aff3361)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:00.116717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 955/1904] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:38:59 2021] POST /identity/v3/users => generated 288 bytes in 677 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:00.123927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17edad9-b740-4d4c-94ae-ec4153fbb7a3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:00.130533 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e17edad9-b740-4d4c-94ae-ec4153fbb7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:00.183338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:00.185595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17edad9-b740-4d4c-94ae-ec4153fbb7a3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:00.207423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8ae1-728d-4d41-8a43-e6b8186e930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:00.208477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8ae1-728d-4d41-8a43-e6b8186e930f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:00.208965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8ae1-728d-4d41-8a43-e6b8186e930f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:00.209455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8ae1-728d-4d41-8a43-e6b8186e930f admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:00.210816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f8ae1-728d-4d41-8a43-e6b8186e930f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:00.273845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f8ae1-728d-4d41-8a43-e6b8186e930f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:00.320012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 956/1905] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:00 2021] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:00.324847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88651aae02a74476843a9d968aff3361'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:00.341580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8ae1-728d-4d41-8a43-e6b8186e930f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:00.352652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88651aae02a74476843a9d968aff3361'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:00.353423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88651aae02a74476843a9d968aff3361'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:00.363773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8ae1-728d-4d41-8a43-e6b8186e930f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:00.367690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88651aae02a74476843a9d968aff3361'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:00.378384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7365ef-4f92-4db8-8ae2-e465296b8c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:00.380113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7365ef-4f92-4db8-8ae2-e465296b8c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:00.381178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7365ef-4f92-4db8-8ae2-e465296b8c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:00.382040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7365ef-4f92-4db8-8ae2-e465296b8c8f admin admin] PATH_INFO: `/v3/projects/592f3e02ebed4dc2b8ec77685579e681/users/f3359c75abc24f85bc17f52d3f9531d0/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:00.409672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a5f1fb65-31ac-4065-9aa3-7e416b2f2d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88651aae02a74476843a9d968aff3361'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:00.425076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7365ef-4f92-4db8-8ae2-e465296b8c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=592f3e02ebed4dc2b8ec77685579e681, user_id=f3359c75abc24f85bc17f52d3f9531d0, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:00.426873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 950/1906] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:38:59 2021] DELETE /identity/v3/users/88651aae02a74476843a9d968aff3361 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:00.488243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7365ef-4f92-4db8-8ae2-e465296b8c8f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:00.520058 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 957/1907] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:00 2021] PUT /identity/v3/projects/592f3e02ebed4dc2b8ec77685579e681/users/f3359c75abc24f85bc17f52d3f9531d0/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:00.539377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07d3f-bc66-4c07-975a-e13f2442af9e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:00.539906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07d3f-bc66-4c07-975a-e13f2442af9e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:00.540398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07d3f-bc66-4c07-975a-e13f2442af9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:00.611905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2ce07d3f-bc66-4c07-975a-e13f2442af9e None None] MFA Rules not processed for user `f3359c75abc24f85bc17f52d3f9531d0`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:00.613942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2ce07d3f-bc66-4c07-975a-e13f2442af9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:00.803229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 951/1908] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:00 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:01.067991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7365ef-4f92-4db8-8ae2-e465296b8c8f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:01.068850 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1a7365ef-4f92-4db8-8ae2-e465296b8c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:01.219509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7365ef-4f92-4db8-8ae2-e465296b8c8f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:01.227745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11fed3-5b9e-4714-a55c-16e0a1762a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:01.229552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11fed3-5b9e-4714-a55c-16e0a1762a08 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:01.230662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11fed3-5b9e-4714-a55c-16e0a1762a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:01.231575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11fed3-5b9e-4714-a55c-16e0a1762a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:01.249511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11fed3-5b9e-4714-a55c-16e0a1762a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:01.292214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11fed3-5b9e-4714-a55c-16e0a1762a08 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:01.307352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 958/1909] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:01 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:02.043549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce07d3f-bc66-4c07-975a-e13f2442af9e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:02.047181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2ce07d3f-bc66-4c07-975a-e13f2442af9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:02.257475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce07d3f-bc66-4c07-975a-e13f2442af9e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:02.280912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:02.283384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:02.284165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:02.284722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] PATH_INFO: `/v3/projects/aa9ac78aa5c54f08bb1a09aeccb78458` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:02.289382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9ac78aa5c54f08bb1a09aeccb78458)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:02.371762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:02.500769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9ac78aa5c54f08bb1a09aeccb78458', 'request_id': 'req-6d53e642-0d22-4421-8739-eee905f670ce'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:02.528282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9ac78aa5c54f08bb1a09aeccb78458', 'request_id': 'req-6d53e642-0d22-4421-8739-eee905f670ce'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:02.544782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9ac78aa5c54f08bb1a09aeccb78458', 'request_id': 'req-6d53e642-0d22-4421-8739-eee905f670ce'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:02.571339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] The token cache is being invalidate because project aa9ac78aa5c54f08bb1a09aeccb78458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:02.572742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:02.574043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6d53e642-0d22-4421-8739-eee905f670ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:02.576834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 952/1910] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:02 2021] DELETE /identity/v3/projects/aa9ac78aa5c54f08bb1a09aeccb78458 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:02.586063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245fa16-f80f-44a9-9ae4-05648b36295d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:02.589334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245fa16-f80f-44a9-9ae4-05648b36295d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:02.591251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245fa16-f80f-44a9-9ae4-05648b36295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:02.647849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-7245fa16-f80f-44a9-9ae4-05648b36295d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:02.649358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7245fa16-f80f-44a9-9ae4-05648b36295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:02.798931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 959/1911] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:02.812473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a0fc-0234-495d-8d34-4231784e30ef None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:02.813164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a0fc-0234-495d-8d34-4231784e30ef None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:02.813620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a0fc-0234-495d-8d34-4231784e30ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:02.862349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-98f0a0fc-0234-495d-8d34-4231784e30ef None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:02.864543 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-98f0a0fc-0234-495d-8d34-4231784e30ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:02.879244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 953/1912] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:02.880823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245fa16-f80f-44a9-9ae4-05648b36295d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:02.901521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245fa16-f80f-44a9-9ae4-05648b36295d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:02.929765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249628-37db-4be9-9fad-c72194e229d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:02.933667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249628-37db-4be9-9fad-c72194e229d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:02.934120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249628-37db-4be9-9fad-c72194e229d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:02.934473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249628-37db-4be9-9fad-c72194e229d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:02.935401 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249628-37db-4be9-9fad-c72194e229d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:02.935788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249628-37db-4be9-9fad-c72194e229d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:03.005641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249628-37db-4be9-9fad-c72194e229d0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:03.039155 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 960/1913] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:03.039359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a0fc-0234-495d-8d34-4231784e30ef None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:03.054740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a0fc-0234-495d-8d34-4231784e30ef None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:03.064764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465988a-6790-4555-badd-0bb85b1745be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:03.065829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465988a-6790-4555-badd-0bb85b1745be admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:03.066365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465988a-6790-4555-badd-0bb85b1745be admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:03.066875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465988a-6790-4555-badd-0bb85b1745be admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:03.070811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465988a-6790-4555-badd-0bb85b1745be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:03.196452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465988a-6790-4555-badd-0bb85b1745be admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:03.258399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 954/1914] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:03 2021] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:03.262750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249628-37db-4be9-9fad-c72194e229d0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:03.277717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249628-37db-4be9-9fad-c72194e229d0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:03.424504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da73082-36e7-4e36-b420-f366ea68df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:03.425565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da73082-36e7-4e36-b420-f366ea68df6c admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:03.426036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da73082-36e7-4e36-b420-f366ea68df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:03.426374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da73082-36e7-4e36-b420-f366ea68df6c admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:03.427355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da73082-36e7-4e36-b420-f366ea68df6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:03.463771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da73082-36e7-4e36-b420-f366ea68df6c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:03.496508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 961/1915] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:03 2021] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:03.501146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465988a-6790-4555-badd-0bb85b1745be admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:03.520308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465988a-6790-4555-badd-0bb85b1745be admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:03.528522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00530d-2e27-4185-8394-38ff536a1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:03.529940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00530d-2e27-4185-8394-38ff536a1307 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:03.530315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00530d-2e27-4185-8394-38ff536a1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:03.531686 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00530d-2e27-4185-8394-38ff536a1307 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:03.533503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00530d-2e27-4185-8394-38ff536a1307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:03.592769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00530d-2e27-4185-8394-38ff536a1307 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:03.628422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 955/1916] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:03 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:03.632703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da73082-36e7-4e36-b420-f366ea68df6c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:03.648587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da73082-36e7-4e36-b420-f366ea68df6c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:03.655318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbd37e-3c0f-4d62-89b3-ff8301068364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:03.656589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbd37e-3c0f-4d62-89b3-ff8301068364 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:03.658647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbd37e-3c0f-4d62-89b3-ff8301068364 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:03.658647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbd37e-3c0f-4d62-89b3-ff8301068364 admin admin] PATH_INFO: `/v3/projects/7a0291385c194e659fd8cd83c7b3d89e/users/b144ded7fb4a4cd59207c8f83e00d5cd/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:03.695408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbd37e-3c0f-4d62-89b3-ff8301068364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0291385c194e659fd8cd83c7b3d89e, user_id=b144ded7fb4a4cd59207c8f83e00d5cd, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:03.756478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbd37e-3c0f-4d62-89b3-ff8301068364 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:03.790147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 962/1917] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:03 2021] PUT /identity/v3/projects/7a0291385c194e659fd8cd83c7b3d89e/users/b144ded7fb4a4cd59207c8f83e00d5cd/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:03.793074 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1bb6c-bdc6-436a-99e8-846310c0fd97 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:03.793568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1bb6c-bdc6-436a-99e8-846310c0fd97 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:03.794066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1bb6c-bdc6-436a-99e8-846310c0fd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:03.820998 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-05f1bb6c-bdc6-436a-99e8-846310c0fd97 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:03.822649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-05f1bb6c-bdc6-436a-99e8-846310c0fd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:03.930053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 956/1918] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:03.945873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbd37e-3c0f-4d62-89b3-ff8301068364 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:03.948704 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a8cbd37e-3c0f-4d62-89b3-ff8301068364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:04.090936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbd37e-3c0f-4d62-89b3-ff8301068364 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:04.099149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e370163-1ffe-498e-a305-99963f8935b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:04.100168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370163-1ffe-498e-a305-99963f8935b7 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:04.101899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370163-1ffe-498e-a305-99963f8935b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:04.102511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370163-1ffe-498e-a305-99963f8935b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:04.120910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e370163-1ffe-498e-a305-99963f8935b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:04.176484 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e370163-1ffe-498e-a305-99963f8935b7 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:04.210033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 963/1919] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:04.286480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1bb6c-bdc6-436a-99e8-846310c0fd97 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:04.289175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-05f1bb6c-bdc6-436a-99e8-846310c0fd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:04.342339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1bb6c-bdc6-436a-99e8-846310c0fd97 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:04.362171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:04.363896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:04.364398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:04.365350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] PATH_INFO: `/v3/users/0edfe474d2354005b2d78f81cedd12ac` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:04.367621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edfe474d2354005b2d78f81cedd12ac)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:04.492368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:04.585737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edfe474d2354005b2d78f81cedd12ac'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:04.599405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edfe474d2354005b2d78f81cedd12ac'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:04.600683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edfe474d2354005b2d78f81cedd12ac'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:04.625968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edfe474d2354005b2d78f81cedd12ac'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:04.656630 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edfe474d2354005b2d78f81cedd12ac'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:04.684656 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 957/1920] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:04 2021] DELETE /identity/v3/users/0edfe474d2354005b2d78f81cedd12ac => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:04.692225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8316f3-cf53-477d-ae50-240e6d91e7a2 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:04.693810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8316f3-cf53-477d-ae50-240e6d91e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:04.694598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8316f3-cf53-477d-ae50-240e6d91e7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:04.786332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-ae8316f3-cf53-477d-ae50-240e6d91e7a2 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:04.788861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ae8316f3-cf53-477d-ae50-240e6d91e7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:04.976515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 964/1921] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:05.278465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:05.281005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:05.433294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec51ef5-3617-43d9-8e12-99e1765a6ed8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:05.441594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f7c7f-29ee-42b6-80d1-0a59b4fd5074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:05.442689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f7c7f-29ee-42b6-80d1-0a59b4fd5074 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:05.443273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f7c7f-29ee-42b6-80d1-0a59b4fd5074 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:05.443846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f7c7f-29ee-42b6-80d1-0a59b4fd5074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:05.462212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f7c7f-29ee-42b6-80d1-0a59b4fd5074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:05.513686 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f7c7f-29ee-42b6-80d1-0a59b4fd5074 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:05.534331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 958/1922] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:06.831129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8316f3-cf53-477d-ae50-240e6d91e7a2 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:06.836222 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ae8316f3-cf53-477d-ae50-240e6d91e7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:06.884297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8316f3-cf53-477d-ae50-240e6d91e7a2 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:06.909037 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:06.914903 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:06.915951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:06.916799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] PATH_INFO: `/v3/projects/1e19c76d2a7047e68d1907148a847dc1` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:06.920414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e19c76d2a7047e68d1907148a847dc1)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:07.012215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:07.098548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2991dec-f09a-447f-81a3-55af09dffa0a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:07.099579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2991dec-f09a-447f-81a3-55af09dffa0a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:07.099932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2991dec-f09a-447f-81a3-55af09dffa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:07.255912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e19c76d2a7047e68d1907148a847dc1', 'request_id': 'req-a5022259-163a-46d1-bc1c-4d5a74a5060a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.315635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e19c76d2a7047e68d1907148a847dc1', 'request_id': 'req-a5022259-163a-46d1-bc1c-4d5a74a5060a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.338595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e19c76d2a7047e68d1907148a847dc1', 'request_id': 'req-a5022259-163a-46d1-bc1c-4d5a74a5060a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.385919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] The token cache is being invalidate because project 1e19c76d2a7047e68d1907148a847dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:07.386839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.394943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.400463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 965/1923] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:06 2021] DELETE /identity/v3/projects/1e19c76d2a7047e68d1907148a847dc1 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:07.412775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:07.420527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:07.523469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b2991dec-f09a-447f-81a3-55af09dffa0a None None] MFA Rules not processed for user `b144ded7fb4a4cd59207c8f83e00d5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:07.524909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b2991dec-f09a-447f-81a3-55af09dffa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:07.617239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022259-163a-46d1-bc1c-4d5a74a5060a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:07.629547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:07.630512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:07.630512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:07.630512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] PATH_INFO: `/v3/users/4bbb2c68a33d4a239f1fa18826e7a427` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:07.632928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbb2c68a33d4a239f1fa18826e7a427)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:07.690675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 959/1924] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:07 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 595 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:07.693568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:07.697293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2991dec-f09a-447f-81a3-55af09dffa0a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:07.698887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b2991dec-f09a-447f-81a3-55af09dffa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:07.728658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2991dec-f09a-447f-81a3-55af09dffa0a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:07.750768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b4780-107f-497a-bc46-06899d4a2a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:07.752089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b4780-107f-497a-bc46-06899d4a2a2d admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:07.752300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b4780-107f-497a-bc46-06899d4a2a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:07.752781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b4780-107f-497a-bc46-06899d4a2a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:07.754185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b4780-107f-497a-bc46-06899d4a2a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:07.811064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbb2c68a33d4a239f1fa18826e7a427'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.816960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b4780-107f-497a-bc46-06899d4a2a2d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:07.847358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbb2c68a33d4a239f1fa18826e7a427'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.861221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbb2c68a33d4a239f1fa18826e7a427'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.862662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbb2c68a33d4a239f1fa18826e7a427'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.876449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbb2c68a33d4a239f1fa18826e7a427'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:07.884632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 960/1925] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:07 2021] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:07.886805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b4780-107f-497a-bc46-06899d4a2a2d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:07.889632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-0b7b4780-107f-497a-bc46-06899d4a2a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:07.894261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 966/1926] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:07 2021] DELETE /identity/v3/users/4bbb2c68a33d4a239f1fa18826e7a427 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:08.020243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b4780-107f-497a-bc46-06899d4a2a2d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:08.159367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e238ad-b416-403d-8d78-b30b14108b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:08.161685 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e238ad-b416-403d-8d78-b30b14108b30 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:08.162321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e238ad-b416-403d-8d78-b30b14108b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:08.162950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e238ad-b416-403d-8d78-b30b14108b30 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:08.164147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e238ad-b416-403d-8d78-b30b14108b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:08.216607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e238ad-b416-403d-8d78-b30b14108b30 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:08.248760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 961/1927] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:07 2021] POST /identity/v3/users => generated 291 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:08.255581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:08.300162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fcb12-a962-444a-a463-667f27abb133 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:08.319646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d59ba-848c-447f-a301-4f583fe7d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:08.323078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d59ba-848c-447f-a301-4f583fe7d5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:08.323773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d59ba-848c-447f-a301-4f583fe7d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:08.324444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d59ba-848c-447f-a301-4f583fe7d5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:08.325976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d59ba-848c-447f-a301-4f583fe7d5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:08.386961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d59ba-848c-447f-a301-4f583fe7d5b0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:08.414258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 967/1928] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:08 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:08.418933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e238ad-b416-403d-8d78-b30b14108b30 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:08.436790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e238ad-b416-403d-8d78-b30b14108b30 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:08.446833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b5dde-d4be-41d4-8c3a-b5d33b7e4cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:08.448439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5dde-d4be-41d4-8c3a-b5d33b7e4cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:08.448985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5dde-d4be-41d4-8c3a-b5d33b7e4cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:08.449551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5dde-d4be-41d4-8c3a-b5d33b7e4cb5 admin admin] PATH_INFO: `/v3/projects/aa844bed3d2e4085ac814cc6568d7ec7/users/42b7b7527143431c95ade6ff01d1d1e8/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:08.497658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b5dde-d4be-41d4-8c3a-b5d33b7e4cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa844bed3d2e4085ac814cc6568d7ec7, user_id=42b7b7527143431c95ade6ff01d1d1e8, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:08.616778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b5dde-d4be-41d4-8c3a-b5d33b7e4cb5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:08.664513 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 962/1929] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:08 2021] PUT /identity/v3/projects/aa844bed3d2e4085ac814cc6568d7ec7/users/42b7b7527143431c95ade6ff01d1d1e8/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:08.679770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d59ba-848c-447f-a301-4f583fe7d5b0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:08.689788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b5dde-d4be-41d4-8c3a-b5d33b7e4cb5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:08.693586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d40b5dde-d4be-41d4-8c3a-b5d33b7e4cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:08.700498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d59ba-848c-447f-a301-4f583fe7d5b0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:08.911781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b5dde-d4be-41d4-8c3a-b5d33b7e4cb5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:08.930358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:08.931202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:08.931640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:08.931850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] PATH_INFO: `/v3/projects/b548c05dc8f9493598d970db05227edb` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:08.933737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b548c05dc8f9493598d970db05227edb)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:08.955628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aafe3b-c6cc-450d-80a5-cab145038f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:08.957076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aafe3b-c6cc-450d-80a5-cab145038f98 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:08.957720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aafe3b-c6cc-450d-80a5-cab145038f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:08.958671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aafe3b-c6cc-450d-80a5-cab145038f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:08.960844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aafe3b-c6cc-450d-80a5-cab145038f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:08.970585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:09.030252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aafe3b-c6cc-450d-80a5-cab145038f98 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:09.064068 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 968/1930] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:08 2021] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:09.071387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aafe3b-c6cc-450d-80a5-cab145038f98 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:09.105689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b548c05dc8f9493598d970db05227edb', 'request_id': 'req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:09.133136 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b548c05dc8f9493598d970db05227edb', 'request_id': 'req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:09.135255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aafe3b-c6cc-450d-80a5-cab145038f98 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:09.148641 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b548c05dc8f9493598d970db05227edb', 'request_id': 'req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:09.176853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] The token cache is being invalidate because project b548c05dc8f9493598d970db05227edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:09.178936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:09.182771 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-2fbb9ca2-78cb-4d88-aa09-4ca41c1d3d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:09.187164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 963/1931] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:08 2021] DELETE /identity/v3/projects/b548c05dc8f9493598d970db05227edb => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:09.197882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d6eb0-3a6b-4609-b967-3f44c73fbb0e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:09.199063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d6eb0-3a6b-4609-b967-3f44c73fbb0e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:09.201019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d6eb0-3a6b-4609-b967-3f44c73fbb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:09.255776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-af4d6eb0-3a6b-4609-b967-3f44c73fbb0e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:09.257696 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-af4d6eb0-3a6b-4609-b967-3f44c73fbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:09.366040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 964/1932] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:09.381176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ff22-be49-40f7-8116-688aea68f058 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:09.381600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ff22-be49-40f7-8116-688aea68f058 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:09.382016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ff22-be49-40f7-8116-688aea68f058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:09.421701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49666a-b61d-4cda-bd55-0b6558697f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:09.423573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49666a-b61d-4cda-bd55-0b6558697f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:09.424208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49666a-b61d-4cda-bd55-0b6558697f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:09.424816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49666a-b61d-4cda-bd55-0b6558697f3a admin admin] PATH_INFO: `/v3/projects/aa844bed3d2e4085ac814cc6568d7ec7/users/42b7b7527143431c95ade6ff01d1d1e8/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:09.426415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-13f5ff22-be49-40f7-8116-688aea68f058 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:09.428316 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-13f5ff22-be49-40f7-8116-688aea68f058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:09.428820 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49666a-b61d-4cda-bd55-0b6558697f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa844bed3d2e4085ac814cc6568d7ec7, user_id=42b7b7527143431c95ade6ff01d1d1e8, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:09.440684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 965/1933] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:09.447065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5ff22-be49-40f7-8116-688aea68f058 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:09.458320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5ff22-be49-40f7-8116-688aea68f058 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:09.465747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd9a7c-186d-4569-8bcc-9aee29baf2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:09.467092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd9a7c-186d-4569-8bcc-9aee29baf2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:09.467456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd9a7c-186d-4569-8bcc-9aee29baf2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:09.467809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd9a7c-186d-4569-8bcc-9aee29baf2d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:09.468635 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd9a7c-186d-4569-8bcc-9aee29baf2d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:09.469004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd9a7c-186d-4569-8bcc-9aee29baf2d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:09.506485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd9a7c-186d-4569-8bcc-9aee29baf2d3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:09.523874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 966/1934] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:39:09.537500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49666a-b61d-4cda-bd55-0b6558697f3a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:09.538582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd9a7c-186d-4569-8bcc-9aee29baf2d3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:09.566086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 969/1935] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:09 2021] PUT /identity/v3/projects/aa844bed3d2e4085ac814cc6568d7ec7/users/42b7b7527143431c95ade6ff01d1d1e8/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:09.571941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49666a-b61d-4cda-bd55-0b6558697f3a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:09.574616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7d49666a-b61d-4cda-bd55-0b6558697f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:09.577062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd9a7c-186d-4569-8bcc-9aee29baf2d3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:09.711699 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962bd5a-df3d-4c1e-ac35-b52e2eb1d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:09.712436 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962bd5a-df3d-4c1e-ac35-b52e2eb1d480 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:09.712791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962bd5a-df3d-4c1e-ac35-b52e2eb1d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:09.713189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962bd5a-df3d-4c1e-ac35-b52e2eb1d480 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:09.713976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962bd5a-df3d-4c1e-ac35-b52e2eb1d480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:09.771642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49666a-b61d-4cda-bd55-0b6558697f3a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:09.773226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962bd5a-df3d-4c1e-ac35-b52e2eb1d480 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:09.778777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c3a31-34ad-4068-9a77-a50f20f89f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:09.779716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c3a31-34ad-4068-9a77-a50f20f89f5e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:09.780013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c3a31-34ad-4068-9a77-a50f20f89f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:09.780316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c3a31-34ad-4068-9a77-a50f20f89f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:09.781191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c3a31-34ad-4068-9a77-a50f20f89f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:09.821551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c3a31-34ad-4068-9a77-a50f20f89f5e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:09.835853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 967/1936] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:09 2021] POST /identity/v3/projects => generated 381 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:09.842247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 970/1937] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:09 2021] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:09.847802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c3a31-34ad-4068-9a77-a50f20f89f5e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:09.851387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962bd5a-df3d-4c1e-ac35-b52e2eb1d480 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:09.865857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c3a31-34ad-4068-9a77-a50f20f89f5e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:09.969234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79051dc7-1727-4ba0-af78-4f5b21244fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:09.971001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79051dc7-1727-4ba0-af78-4f5b21244fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:09.971001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79051dc7-1727-4ba0-af78-4f5b21244fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:09.971844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79051dc7-1727-4ba0-af78-4f5b21244fbb admin admin] PATH_INFO: `/v3/projects/aa844bed3d2e4085ac814cc6568d7ec7/users/42b7b7527143431c95ade6ff01d1d1e8/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:09.974989 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79051dc7-1727-4ba0-af78-4f5b21244fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa844bed3d2e4085ac814cc6568d7ec7, user_id=42b7b7527143431c95ade6ff01d1d1e8, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:10.001767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962bd5a-df3d-4c1e-ac35-b52e2eb1d480 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:10.007727 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79051dc7-1727-4ba0-af78-4f5b21244fbb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:10.013798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ddfc7-8ac5-4508-814f-452661be8147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:10.018394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ddfc7-8ac5-4508-814f-452661be8147 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:10.019310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ddfc7-8ac5-4508-814f-452661be8147 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:10.019850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ddfc7-8ac5-4508-814f-452661be8147 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:10.020692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ddfc7-8ac5-4508-814f-452661be8147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:10.038970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 971/1938] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:09 2021] PUT /identity/v3/projects/aa844bed3d2e4085ac814cc6568d7ec7/users/42b7b7527143431c95ade6ff01d1d1e8/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:10.076250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ddfc7-8ac5-4508-814f-452661be8147 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:10.108866 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 968/1939] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:09 2021] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:10.110179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79051dc7-1727-4ba0-af78-4f5b21244fbb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:10.216099 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79051dc7-1727-4ba0-af78-4f5b21244fbb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:10.225527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398f7c2-ac9c-4c43-ba72-c4885bf41710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:10.227507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f7c2-ac9c-4c43-ba72-c4885bf41710 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:10.227507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f7c2-ac9c-4c43-ba72-c4885bf41710 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:10.227801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f7c2-ac9c-4c43-ba72-c4885bf41710 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:10.229159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398f7c2-ac9c-4c43-ba72-c4885bf41710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:10.283890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398f7c2-ac9c-4c43-ba72-c4885bf41710 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:10.304596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 972/1940] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:10 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:10.310219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ddfc7-8ac5-4508-814f-452661be8147 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:10.322241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ddfc7-8ac5-4508-814f-452661be8147 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:10.329482 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94d0a6-1c5d-4b71-a775-0197d4242c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:10.329482 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94d0a6-1c5d-4b71-a775-0197d4242c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:10.330124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94d0a6-1c5d-4b71-a775-0197d4242c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:10.330258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94d0a6-1c5d-4b71-a775-0197d4242c47 admin admin] PATH_INFO: `/v3/projects/2de5348f863f4930929d618faed58820/users/836de7f4c7934f57aa5bd5ebb6272313/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:10.361462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94d0a6-1c5d-4b71-a775-0197d4242c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de5348f863f4930929d618faed58820, user_id=836de7f4c7934f57aa5bd5ebb6272313, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:10.397649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94d0a6-1c5d-4b71-a775-0197d4242c47 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:10.422715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 969/1941] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:10 2021] PUT /identity/v3/projects/2de5348f863f4930929d618faed58820/users/836de7f4c7934f57aa5bd5ebb6272313/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:10.442759 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292db70-bdc4-4a3f-9d32-04fc63aa6a0f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:10.443458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292db70-bdc4-4a3f-9d32-04fc63aa6a0f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:10.444026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292db70-bdc4-4a3f-9d32-04fc63aa6a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:10.519941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d292db70-bdc4-4a3f-9d32-04fc63aa6a0f None None] MFA Rules not processed for user `836de7f4c7934f57aa5bd5ebb6272313`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:10.522053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d292db70-bdc4-4a3f-9d32-04fc63aa6a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:10.712147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 973/1942] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:10 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:10.719422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94d0a6-1c5d-4b71-a775-0197d4242c47 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:10.826360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94d0a6-1c5d-4b71-a775-0197d4242c47 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:10.832850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b629-66f2-48fd-86c7-a7dfb47129ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:10.833780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b629-66f2-48fd-86c7-a7dfb47129ce admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:10.834286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b629-66f2-48fd-86c7-a7dfb47129ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:10.834760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b629-66f2-48fd-86c7-a7dfb47129ce admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:10.835614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b629-66f2-48fd-86c7-a7dfb47129ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:10.867250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b629-66f2-48fd-86c7-a7dfb47129ce admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:10.900240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 970/1943] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:10 2021] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:10.906453 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292db70-bdc4-4a3f-9d32-04fc63aa6a0f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:10.923262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292db70-bdc4-4a3f-9d32-04fc63aa6a0f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.044290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b7836-d545-4d1b-a4e9-ad4c118933d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.045334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b7836-d545-4d1b-a4e9-ad4c118933d2 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.045791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b7836-d545-4d1b-a4e9-ad4c118933d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.046206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b7836-d545-4d1b-a4e9-ad4c118933d2 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.047195 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b7836-d545-4d1b-a4e9-ad4c118933d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:11.081125 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b7836-d545-4d1b-a4e9-ad4c118933d2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.134112 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 974/1944] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:10 2021] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:11.134607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b629-66f2-48fd-86c7-a7dfb47129ce admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.159314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b629-66f2-48fd-86c7-a7dfb47129ce admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.170673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac26e6-df5c-42b0-9f3e-dd8260769005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.173504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac26e6-df5c-42b0-9f3e-dd8260769005 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.175250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac26e6-df5c-42b0-9f3e-dd8260769005 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.176194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac26e6-df5c-42b0-9f3e-dd8260769005 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.178113 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac26e6-df5c-42b0-9f3e-dd8260769005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:11.296105 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac26e6-df5c-42b0-9f3e-dd8260769005 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.336275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b7836-d545-4d1b-a4e9-ad4c118933d2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.349101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 971/1945] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:11.370109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b7836-d545-4d1b-a4e9-ad4c118933d2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.370109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2237a7-5561-49ce-ab81-907e4cad6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.370109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2237a7-5561-49ce-ab81-907e4cad6cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.370109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2237a7-5561-49ce-ab81-907e4cad6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.370899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2237a7-5561-49ce-ab81-907e4cad6cbe admin admin] PATH_INFO: `/v3/projects/ca4fd72de3234a9aa858507fcc08d444/users/aaa3a300d0d84af9a7fc9f899199092e/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.415867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2237a7-5561-49ce-ab81-907e4cad6cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4fd72de3234a9aa858507fcc08d444, user_id=aaa3a300d0d84af9a7fc9f899199092e, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:11.424922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc613b9a-3a64-4cbc-a934-f43b4260713c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.425420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc613b9a-3a64-4cbc-a934-f43b4260713c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.425852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc613b9a-3a64-4cbc-a934-f43b4260713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.489569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2237a7-5561-49ce-ab81-907e4cad6cbe admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.514459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 975/1946] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:11 2021] PUT /identity/v3/projects/ca4fd72de3234a9aa858507fcc08d444/users/aaa3a300d0d84af9a7fc9f899199092e/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:11.518877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2237a7-5561-49ce-ab81-907e4cad6cbe admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.528098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-fc613b9a-3a64-4cbc-a934-f43b4260713c None None] MFA Rules not processed for user `42b7b7527143431c95ade6ff01d1d1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:11.531014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-fc613b9a-3a64-4cbc-a934-f43b4260713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.638887 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2237a7-5561-49ce-ab81-907e4cad6cbe admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.649245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8b123-4e7d-4376-a208-8908a889e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.650358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8b123-4e7d-4376-a208-8908a889e91d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.650860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8b123-4e7d-4376-a208-8908a889e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.651661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8b123-4e7d-4376-a208-8908a889e91d admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.653429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8b123-4e7d-4376-a208-8908a889e91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:11.680463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 972/1947] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:11 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:11.715605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8b123-4e7d-4376-a208-8908a889e91d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.743949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc613b9a-3a64-4cbc-a934-f43b4260713c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.754143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 976/1948] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:11.757322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8b123-4e7d-4376-a208-8908a889e91d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.762101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc613b9a-3a64-4cbc-a934-f43b4260713c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.765534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4ed8b123-4e7d-4376-a208-8908a889e91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:11.769980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131c26d-f2cd-428d-880a-645ffd5e216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.771537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131c26d-f2cd-428d-880a-645ffd5e216d admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.772162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131c26d-f2cd-428d-880a-645ffd5e216d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.772861 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131c26d-f2cd-428d-880a-645ffd5e216d admin admin] PATH_INFO: `/v3/projects/ca4fd72de3234a9aa858507fcc08d444/users/aaa3a300d0d84af9a7fc9f899199092e/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.776337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131c26d-f2cd-428d-880a-645ffd5e216d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4fd72de3234a9aa858507fcc08d444, user_id=aaa3a300d0d84af9a7fc9f899199092e, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:11.841222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131c26d-f2cd-428d-880a-645ffd5e216d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:11.857897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 973/1949] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:11 2021] PUT /identity/v3/projects/ca4fd72de3234a9aa858507fcc08d444/users/aaa3a300d0d84af9a7fc9f899199092e/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:11.858974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131c26d-f2cd-428d-880a-645ffd5e216d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:11.915625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8b123-4e7d-4376-a208-8908a889e91d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.971029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131c26d-f2cd-428d-880a-645ffd5e216d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:11.979276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e988b-ab11-42c9-b146-c5557a560d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:11.980403 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e988b-ab11-42c9-b146-c5557a560d40 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:11.980857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e988b-ab11-42c9-b146-c5557a560d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:11.981320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e988b-ab11-42c9-b146-c5557a560d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:11.983468 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e988b-ab11-42c9-b146-c5557a560d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:12.007249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.008290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.008797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.009308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.013295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:12.019837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e988b-ab11-42c9-b146-c5557a560d40 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.037349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 974/1950] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:12.042228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e988b-ab11-42c9-b146-c5557a560d40 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.052709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e988b-ab11-42c9-b146-c5557a560d40 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.057401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcffaf6-5248-40bc-96b9-a21419178f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.058425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcffaf6-5248-40bc-96b9-a21419178f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.058713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcffaf6-5248-40bc-96b9-a21419178f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.059176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcffaf6-5248-40bc-96b9-a21419178f06 admin admin] PATH_INFO: `/v3/projects/ca4fd72de3234a9aa858507fcc08d444/users/aaa3a300d0d84af9a7fc9f899199092e/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.061297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcffaf6-5248-40bc-96b9-a21419178f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4fd72de3234a9aa858507fcc08d444, user_id=aaa3a300d0d84af9a7fc9f899199092e, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:12.088485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcffaf6-5248-40bc-96b9-a21419178f06 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.104022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:12.111218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 975/1951] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:12 2021] PUT /identity/v3/projects/ca4fd72de3234a9aa858507fcc08d444/users/aaa3a300d0d84af9a7fc9f899199092e/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:12.124336 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6504f-aea3-46cd-a5c8-952dc466fac4 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.124687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6504f-aea3-46cd-a5c8-952dc466fac4 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.124964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6504f-aea3-46cd-a5c8-952dc466fac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.141798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.160108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 977/1952] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:11 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:12.171638 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f7d6504f-aea3-46cd-a5c8-952dc466fac4 None None] MFA Rules not processed for user `aaa3a300d0d84af9a7fc9f899199092e`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:12.172865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f7d6504f-aea3-46cd-a5c8-952dc466fac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:12.286648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 976/1953] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:12 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:12.302351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.305982 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:12.324358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375aa8c-cce5-40a6-891f-4018e88112c8 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.417015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954a022-6b01-41e7-9155-5ae6bf55b6ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.418042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954a022-6b01-41e7-9155-5ae6bf55b6ac service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.418451 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954a022-6b01-41e7-9155-5ae6bf55b6ac service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.418864 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954a022-6b01-41e7-9155-5ae6bf55b6ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:12.432240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954a022-6b01-41e7-9155-5ae6bf55b6ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:12.473192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954a022-6b01-41e7-9155-5ae6bf55b6ac service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:12.485748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 978/1954] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:12.937309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6504f-aea3-46cd-a5c8-952dc466fac4 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:12.960784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6504f-aea3-46cd-a5c8-952dc466fac4 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:12.970166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3da3f-f4ec-41de-a743-5664f5b7c323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:12.972386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3da3f-f4ec-41de-a743-5664f5b7c323 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:12.973257 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3da3f-f4ec-41de-a743-5664f5b7c323 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:12.974150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3da3f-f4ec-41de-a743-5664f5b7c323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.108457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3da3f-f4ec-41de-a743-5664f5b7c323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:13.153789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3da3f-f4ec-41de-a743-5664f5b7c323 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.170071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 977/1955] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:12 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:13.568444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954a022-6b01-41e7-9155-5ae6bf55b6ac service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.571117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8954a022-6b01-41e7-9155-5ae6bf55b6ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:13.680501 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954a022-6b01-41e7-9155-5ae6bf55b6ac service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.688149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.689536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.690006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.690490 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] PATH_INFO: `/v3/users/668e135d9ce34cbca14aecc866b42ec7` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.692376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] RBAC: Authorizing `identity:delete_user(user_id=668e135d9ce34cbca14aecc866b42ec7)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:13.739867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.795866 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3da3f-f4ec-41de-a743-5664f5b7c323 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:13.814055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3da3f-f4ec-41de-a743-5664f5b7c323 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:13.822142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:13.823876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.825377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.825785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] PATH_INFO: `/v3/users/836de7f4c7934f57aa5bd5ebb6272313` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.828243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=836de7f4c7934f57aa5bd5ebb6272313)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:13.857821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668e135d9ce34cbca14aecc866b42ec7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:13.884698 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668e135d9ce34cbca14aecc866b42ec7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:13.893216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:13.900179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668e135d9ce34cbca14aecc866b42ec7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:13.900179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668e135d9ce34cbca14aecc866b42ec7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:13.911377 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1d5f8f2d-0e4e-4009-9460-f6c9f070066d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668e135d9ce34cbca14aecc866b42ec7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:13.923712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 979/1956] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:13 2021] DELETE /identity/v3/users/668e135d9ce34cbca14aecc866b42ec7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:13.943096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd7707-85fa-4681-bf06-c3350e151c36 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:13.943580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd7707-85fa-4681-bf06-c3350e151c36 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:13.944354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd7707-85fa-4681-bf06-c3350e151c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:13.998498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-fbdd7707-85fa-4681-bf06-c3350e151c36 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:14.000010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-fbdd7707-85fa-4681-bf06-c3350e151c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:14.066621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836de7f4c7934f57aa5bd5ebb6272313'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:14.080779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836de7f4c7934f57aa5bd5ebb6272313'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:14.082060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836de7f4c7934f57aa5bd5ebb6272313'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:14.110334 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836de7f4c7934f57aa5bd5ebb6272313'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:14.140511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 980/1957] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:14.159574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd7707-85fa-4681-bf06-c3350e151c36 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.162792 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-fbdd7707-85fa-4681-bf06-c3350e151c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:14.186691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-39892b91-1be9-48cc-8502-0505c6ea4848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836de7f4c7934f57aa5bd5ebb6272313'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:14.203259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 978/1958] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:13 2021] DELETE /identity/v3/users/836de7f4c7934f57aa5bd5ebb6272313 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:14.206494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbeb8e-7bfe-4b8d-ab0f-9551f1e07f56 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.207048 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbeb8e-7bfe-4b8d-ab0f-9551f1e07f56 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.207549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbeb8e-7bfe-4b8d-ab0f-9551f1e07f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.243293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-cacbeb8e-7bfe-4b8d-ab0f-9551f1e07f56 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:14.245538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cacbeb8e-7bfe-4b8d-ab0f-9551f1e07f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:14.354615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd7707-85fa-4681-bf06-c3350e151c36 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.398168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 979/1959] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:14.399411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbeb8e-7bfe-4b8d-ab0f-9551f1e07f56 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.404997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cacbeb8e-7bfe-4b8d-ab0f-9551f1e07f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:14.512347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074069d-b127-4072-a2bf-523844125a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.513777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074069d-b127-4072-a2bf-523844125a15 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.514514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074069d-b127-4072-a2bf-523844125a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.515231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074069d-b127-4072-a2bf-523844125a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.543036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbeb8e-7bfe-4b8d-ab0f-9551f1e07f56 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.548827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.549802 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.550646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.551429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.554066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:14.559811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074069d-b127-4072-a2bf-523844125a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:14.629258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074069d-b127-4072-a2bf-523844125a15 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.648302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 981/1960] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:14.649667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074069d-b127-4072-a2bf-523844125a15 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:14.651811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b074069d-b127-4072-a2bf-523844125a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:14.672243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074069d-b127-4072-a2bf-523844125a15 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:14.679269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58b07a-b85a-4694-b38d-5c54dddc58b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:14.680723 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b07a-b85a-4694-b38d-5c54dddc58b5 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:14.681214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b07a-b85a-4694-b38d-5c54dddc58b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:14.681755 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b07a-b85a-4694-b38d-5c54dddc58b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:14.683839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:14.702451 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58b07a-b85a-4694-b38d-5c54dddc58b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:14.712430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.729103 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 980/1961] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:14 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:14.763135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58b07a-b85a-4694-b38d-5c54dddc58b5 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:14.783873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 982/1962] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:15.268895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.270991 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:15.309606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8003b7b-a778-4fdf-ad65-60382a1785a1 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.316358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.317599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.318054 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.318532 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] PATH_INFO: `/v3/projects/fdd9ee565477467b8067fc00b6637844` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.320324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd9ee565477467b8067fc00b6637844)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:15.360386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.483838 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd9ee565477467b8067fc00b6637844', 'request_id': 'req-3fc7f91b-0b76-4da1-a522-f98c709bbc75'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.506842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd9ee565477467b8067fc00b6637844', 'request_id': 'req-3fc7f91b-0b76-4da1-a522-f98c709bbc75'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.524282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd9ee565477467b8067fc00b6637844', 'request_id': 'req-3fc7f91b-0b76-4da1-a522-f98c709bbc75'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.547481 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] The token cache is being invalidate because project fdd9ee565477467b8067fc00b6637844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:15.547952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.549132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.552168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 981/1963] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:15 2021] DELETE /identity/v3/projects/fdd9ee565477467b8067fc00b6637844 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:15.558768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58b07a-b85a-4694-b38d-5c54dddc58b5 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.576800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58b07a-b85a-4694-b38d-5c54dddc58b5 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.633837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.636151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:15.724953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.725812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.726202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.726515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] PATH_INFO: `/v3/users/0665561f917a4b578b31c1f16c93f81d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.728065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0665561f917a4b578b31c1f16c93f81d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:15.760610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.775805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7f91b-0b76-4da1-a522-f98c709bbc75 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:15.782900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:15.783873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:15.784302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:15.784694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] PATH_INFO: `/v3/projects/2de5348f863f4930929d618faed58820` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:15.786324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de5348f863f4930929d618faed58820)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:15.820380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:15.835814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0665561f917a4b578b31c1f16c93f81d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.854320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0665561f917a4b578b31c1f16c93f81d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.865339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0665561f917a4b578b31c1f16c93f81d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.866325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0665561f917a4b578b31c1f16c93f81d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.877192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0665561f917a4b578b31c1f16c93f81d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.890321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 983/1964] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:15 2021] DELETE /identity/v3/users/0665561f917a4b578b31c1f16c93f81d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:15.894564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de5348f863f4930929d618faed58820', 'request_id': 'req-771f3264-a523-4853-8f29-032779eec8f1'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.911244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de5348f863f4930929d618faed58820', 'request_id': 'req-771f3264-a523-4853-8f29-032779eec8f1'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.920850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de5348f863f4930929d618faed58820', 'request_id': 'req-771f3264-a523-4853-8f29-032779eec8f1'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.932741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] The token cache is being invalidate because project 2de5348f863f4930929d618faed58820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:15.933061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.933967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:15.935839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 982/1965] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:15 2021] DELETE /identity/v3/projects/2de5348f863f4930929d618faed58820 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:15.940375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:15.942379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:16.049676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55f666-c1bb-45a9-9195-4f40f00fb37e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:16.060030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:16.061565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:16.062086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:16.062469 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] PATH_INFO: `/v3/users/aaa3a300d0d84af9a7fc9f899199092e` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.064549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa3a300d0d84af9a7fc9f899199092e)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:16.125365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:16.238791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa3a300d0d84af9a7fc9f899199092e'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.255663 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa3a300d0d84af9a7fc9f899199092e'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.265533 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa3a300d0d84af9a7fc9f899199092e'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.266500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa3a300d0d84af9a7fc9f899199092e'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.278863 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa3a300d0d84af9a7fc9f899199092e'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.291372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 984/1966] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:15 2021] DELETE /identity/v3/users/aaa3a300d0d84af9a7fc9f899199092e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:16.527212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:16.530190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:16.683828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f3264-a523-4853-8f29-032779eec8f1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:16.822115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:16.823276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:16.823570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:16.823955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] PATH_INFO: `/v3/projects/1fab2deb6e4b49458ce787b11e3c9b64` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.825286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fab2deb6e4b49458ce787b11e3c9b64)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:16.852768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:16.872088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:16.883324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:16.907034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc9de4-22dc-4123-ab4b-a8fd29454130 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:16.912994 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:16.914230 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:16.914651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:16.915054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] PATH_INFO: `/v3/projects/ca4fd72de3234a9aa858507fcc08d444` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:16.916759 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4fd72de3234a9aa858507fcc08d444)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:16.939963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fab2deb6e4b49458ce787b11e3c9b64', 'request_id': 'req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.950860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:16.955135 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fab2deb6e4b49458ce787b11e3c9b64', 'request_id': 'req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.969250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fab2deb6e4b49458ce787b11e3c9b64', 'request_id': 'req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.991504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] The token cache is being invalidate because project 1fab2deb6e4b49458ce787b11e3c9b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:16.991952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.992897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3859ad5e-7d98-47fa-b1cc-5adfcf070c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:16.994815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 983/1967] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:16 2021] DELETE /identity/v3/projects/1fab2deb6e4b49458ce787b11e3c9b64 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:17.001339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e19953-5088-4bb0-bb30-ef787615489b None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.001955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e19953-5088-4bb0-bb30-ef787615489b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.002474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e19953-5088-4bb0-bb30-ef787615489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.034300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-69e19953-5088-4bb0-bb30-ef787615489b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:17.035475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-69e19953-5088-4bb0-bb30-ef787615489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:17.041255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4fd72de3234a9aa858507fcc08d444', 'request_id': 'req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:17.053619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4fd72de3234a9aa858507fcc08d444', 'request_id': 'req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:17.064331 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4fd72de3234a9aa858507fcc08d444', 'request_id': 'req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:17.082282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] The token cache is being invalidate because project ca4fd72de3234a9aa858507fcc08d444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:17.083066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:17.083887 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b6f70ed2-7248-42ee-9e80-63e7e732ee1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:17.085898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 985/1968] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:16 2021] DELETE /identity/v3/projects/ca4fd72de3234a9aa858507fcc08d444 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:17.096149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc1277-7f29-417e-8ac2-9488bd9638f9 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.096734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc1277-7f29-417e-8ac2-9488bd9638f9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.097245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc1277-7f29-417e-8ac2-9488bd9638f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.140804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 984/1969] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:17.149980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-77dc1277-7f29-417e-8ac2-9488bd9638f9 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:17.153774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-77dc1277-7f29-417e-8ac2-9488bd9638f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:17.155464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ace9-a3de-440d-b4a4-9e85cb645b78 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.155992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ace9-a3de-440d-b4a4-9e85cb645b78 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.156511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ace9-a3de-440d-b4a4-9e85cb645b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.171904 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 986/1970] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:17.182281 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecff90d-55f3-4972-8d54-46829c44c5c0 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.183152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecff90d-55f3-4972-8d54-46829c44c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.185017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecff90d-55f3-4972-8d54-46829c44c5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.197639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9946ace9-a3de-440d-b4a4-9e85cb645b78 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:17.199407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9946ace9-a3de-440d-b4a4-9e85cb645b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:17.210087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 985/1971] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:17.217021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ace9-a3de-440d-b4a4-9e85cb645b78 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.227759 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5ecff90d-55f3-4972-8d54-46829c44c5c0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:17.229738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5ecff90d-55f3-4972-8d54-46829c44c5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:17.232380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ace9-a3de-440d-b4a4-9e85cb645b78 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.238846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5079-e55c-467c-a38e-27afbd4fbb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.239828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5079-e55c-467c-a38e-27afbd4fbb4f admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.240271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5079-e55c-467c-a38e-27afbd4fbb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.240717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5079-e55c-467c-a38e-27afbd4fbb4f admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.241382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 987/1972] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:17.241757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a5079-e55c-467c-a38e-27afbd4fbb4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:17.242449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a5079-e55c-467c-a38e-27afbd4fbb4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.246582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecff90d-55f3-4972-8d54-46829c44c5c0 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.262229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecff90d-55f3-4972-8d54-46829c44c5c0 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.269554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b44519-ee1c-4030-b703-5be297474571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.270557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b44519-ee1c-4030-b703-5be297474571 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.271004 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b44519-ee1c-4030-b703-5be297474571 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.271441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b44519-ee1c-4030-b703-5be297474571 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.272610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b44519-ee1c-4030-b703-5be297474571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:17.273075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b44519-ee1c-4030-b703-5be297474571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.290325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a5079-e55c-467c-a38e-27afbd4fbb4f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.311864 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b44519-ee1c-4030-b703-5be297474571 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.312886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 986/1973] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:39:17.318451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5079-e55c-467c-a38e-27afbd4fbb4f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.335711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 988/1974] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:39:17.335982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5079-e55c-467c-a38e-27afbd4fbb4f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.337014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b44519-ee1c-4030-b703-5be297474571 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.338256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9343d7-9e08-4026-9548-439fce5fe4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.339050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9343d7-9e08-4026-9548-439fce5fe4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.339612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9343d7-9e08-4026-9548-439fce5fe4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.340710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9343d7-9e08-4026-9548-439fce5fe4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.341511 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9343d7-9e08-4026-9548-439fce5fe4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.350080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b44519-ee1c-4030-b703-5be297474571 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.355362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e71939-9840-45c8-a3d3-77e53d76fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.356128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e71939-9840-45c8-a3d3-77e53d76fc3e admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.356532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e71939-9840-45c8-a3d3-77e53d76fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.356907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e71939-9840-45c8-a3d3-77e53d76fc3e admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.357663 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e71939-9840-45c8-a3d3-77e53d76fc3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.374931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9343d7-9e08-4026-9548-439fce5fe4a7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.386919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e71939-9840-45c8-a3d3-77e53d76fc3e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.420140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 987/1975] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:17.423210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9343d7-9e08-4026-9548-439fce5fe4a7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.434075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 989/1976] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:17.435622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e71939-9840-45c8-a3d3-77e53d76fc3e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.545440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9343d7-9e08-4026-9548-439fce5fe4a7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.551042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96ba50-5695-49ab-91db-65f622d0d1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.551943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96ba50-5695-49ab-91db-65f622d0d1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.552423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96ba50-5695-49ab-91db-65f622d0d1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.552858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96ba50-5695-49ab-91db-65f622d0d1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.553754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96ba50-5695-49ab-91db-65f622d0d1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.556811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e71939-9840-45c8-a3d3-77e53d76fc3e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.564805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d1511-d091-4809-841a-18e3c69fd78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.565834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d1511-d091-4809-841a-18e3c69fd78a admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.566324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d1511-d091-4809-841a-18e3c69fd78a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.566760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d1511-d091-4809-841a-18e3c69fd78a admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.567855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d1511-d091-4809-841a-18e3c69fd78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.588479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96ba50-5695-49ab-91db-65f622d0d1b3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.617236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 988/1977] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:17.622176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d1511-d091-4809-841a-18e3c69fd78a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.625370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96ba50-5695-49ab-91db-65f622d0d1b3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.642288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96ba50-5695-49ab-91db-65f622d0d1b3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.649381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283d0df-b25c-4e65-86c0-1a523087b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.650354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283d0df-b25c-4e65-86c0-1a523087b29d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.650766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283d0df-b25c-4e65-86c0-1a523087b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.651215 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283d0df-b25c-4e65-86c0-1a523087b29d admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.652267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283d0df-b25c-4e65-86c0-1a523087b29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.657762 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 990/1978] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:17.659096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d1511-d091-4809-841a-18e3c69fd78a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.673226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d1511-d091-4809-841a-18e3c69fd78a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.681314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d990-4547-4efb-8b84-794aa997e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.682351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d990-4547-4efb-8b84-794aa997e19e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.682799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d990-4547-4efb-8b84-794aa997e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.683258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d990-4547-4efb-8b84-794aa997e19e admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.684635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d990-4547-4efb-8b84-794aa997e19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.703418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283d0df-b25c-4e65-86c0-1a523087b29d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.727967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 989/1979] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:17 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:17.735043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d990-4547-4efb-8b84-794aa997e19e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.741129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283d0df-b25c-4e65-86c0-1a523087b29d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.760846 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 991/1980] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:17 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:17.761289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283d0df-b25c-4e65-86c0-1a523087b29d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.763179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d990-4547-4efb-8b84-794aa997e19e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:17.769407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e3b5-7e8a-4bbb-88f7-ca1291e7d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.770833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e3b5-7e8a-4bbb-88f7-ca1291e7d3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.771469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e3b5-7e8a-4bbb-88f7-ca1291e7d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.774545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e3b5-7e8a-4bbb-88f7-ca1291e7d3b1 admin admin] PATH_INFO: `/v3/projects/22ee941b0b3c40338845033ede89635d/users/cd17de7dc438494686f97471d1a32674/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.780130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d990-4547-4efb-8b84-794aa997e19e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:17.787480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4237470-f575-4fca-baa6-f90b77373805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:17.788875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237470-f575-4fca-baa6-f90b77373805 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.789351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237470-f575-4fca-baa6-f90b77373805 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.789837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237470-f575-4fca-baa6-f90b77373805 admin admin] PATH_INFO: `/v3/projects/ecbb2669861b49ac96a3f2538e65f9db/users/734b57ad82ca4cf1ab1561ebb87f6c29/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.825124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e3b5-7e8a-4bbb-88f7-ca1291e7d3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ee941b0b3c40338845033ede89635d, user_id=cd17de7dc438494686f97471d1a32674, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.832025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4237470-f575-4fca-baa6-f90b77373805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbb2669861b49ac96a3f2538e65f9db, user_id=734b57ad82ca4cf1ab1561ebb87f6c29, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:17.858568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e3b5-7e8a-4bbb-88f7-ca1291e7d3b1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.886307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 990/1981] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:17 2021] PUT /identity/v3/projects/22ee941b0b3c40338845033ede89635d/users/cd17de7dc438494686f97471d1a32674/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:17.887036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4237470-f575-4fca-baa6-f90b77373805 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:17.895575 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94d283-bafe-48ba-93b0-ff1b54c556d2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.895953 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94d283-bafe-48ba-93b0-ff1b54c556d2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.896216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94d283-bafe-48ba-93b0-ff1b54c556d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.904239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 992/1982] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:17 2021] PUT /identity/v3/projects/ecbb2669861b49ac96a3f2538e65f9db/users/734b57ad82ca4cf1ab1561ebb87f6c29/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:17.918705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af06dc-f770-4699-902d-ef45190f7e09 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:17.919546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af06dc-f770-4699-902d-ef45190f7e09 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:17.920022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af06dc-f770-4699-902d-ef45190f7e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:17.943084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-ea94d283-bafe-48ba-93b0-ff1b54c556d2 None None] MFA Rules not processed for user `cd17de7dc438494686f97471d1a32674`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:17.944252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ea94d283-bafe-48ba-93b0-ff1b54c556d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:17.991902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a9af06dc-f770-4699-902d-ef45190f7e09 None None] MFA Rules not processed for user `734b57ad82ca4cf1ab1561ebb87f6c29`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:17.993900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a9af06dc-f770-4699-902d-ef45190f7e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:18.059655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 991/1983] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:18.067111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94d283-bafe-48ba-93b0-ff1b54c556d2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.091063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 993/1984] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:17 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:18.104943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af06dc-f770-4699-902d-ef45190f7e09 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.106896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a9af06dc-f770-4699-902d-ef45190f7e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:18.169158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94d283-bafe-48ba-93b0-ff1b54c556d2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.177949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5d370-d51f-4951-9279-2803472602c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.178980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5d370-d51f-4951-9279-2803472602c3 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.179480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5d370-d51f-4951-9279-2803472602c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.180116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5d370-d51f-4951-9279-2803472602c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.181275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5d370-d51f-4951-9279-2803472602c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:18.188496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af06dc-f770-4699-902d-ef45190f7e09 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.192462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fabfb7-a459-4473-81d7-dbc3c03cd666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.193228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fabfb7-a459-4473-81d7-dbc3c03cd666 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.193445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fabfb7-a459-4473-81d7-dbc3c03cd666 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.193971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fabfb7-a459-4473-81d7-dbc3c03cd666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.207225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fabfb7-a459-4473-81d7-dbc3c03cd666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:18.224873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5d370-d51f-4951-9279-2803472602c3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:18.258829 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fabfb7-a459-4473-81d7-dbc3c03cd666 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:18.271881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 992/1985] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:18 2021] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:18.273066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 994/1986] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:18 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:18.277519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5d370-d51f-4951-9279-2803472602c3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.307889 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fabfb7-a459-4473-81d7-dbc3c03cd666 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.322565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fabfb7-a459-4473-81d7-dbc3c03cd666 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.393064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5d370-d51f-4951-9279-2803472602c3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.398195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59815a2b-82fe-4bd2-8a98-b3fda6912582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.398824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59815a2b-82fe-4bd2-8a98-b3fda6912582 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.399141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59815a2b-82fe-4bd2-8a98-b3fda6912582 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.399671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59815a2b-82fe-4bd2-8a98-b3fda6912582 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.400389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59815a2b-82fe-4bd2-8a98-b3fda6912582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:18.424970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.426232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.426717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.427239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] PATH_INFO: `/v3/users/734b57ad82ca4cf1ab1561ebb87f6c29` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.427886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59815a2b-82fe-4bd2-8a98-b3fda6912582 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:18.429024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=734b57ad82ca4cf1ab1561ebb87f6c29)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:18.460542 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 993/1987] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:18 2021] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:18.465981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:18.468243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59815a2b-82fe-4bd2-8a98-b3fda6912582 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.485593 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59815a2b-82fe-4bd2-8a98-b3fda6912582 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.493793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b59724-2364-4ffd-8d8d-33df095c7ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.494879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b59724-2364-4ffd-8d8d-33df095c7ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.495336 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b59724-2364-4ffd-8d8d-33df095c7ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.495775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b59724-2364-4ffd-8d8d-33df095c7ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.497052 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b59724-2364-4ffd-8d8d-33df095c7ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:18.531216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734b57ad82ca4cf1ab1561ebb87f6c29'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.547729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734b57ad82ca4cf1ab1561ebb87f6c29'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.549943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b59724-2364-4ffd-8d8d-33df095c7ac1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:18.557925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734b57ad82ca4cf1ab1561ebb87f6c29'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.559197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734b57ad82ca4cf1ab1561ebb87f6c29'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.569701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-60c10d71-744d-434d-bb40-f1051acff96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734b57ad82ca4cf1ab1561ebb87f6c29'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:18.570210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 994/1988] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:18 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:18.575407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b59724-2364-4ffd-8d8d-33df095c7ac1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.577895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-51b59724-2364-4ffd-8d8d-33df095c7ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:18.581214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 995/1989] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:18 2021] DELETE /identity/v3/users/734b57ad82ca4cf1ab1561ebb87f6c29 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:18.588139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a265da-fa27-43ce-bc3c-edfb38f7ecc1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.588584 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a265da-fa27-43ce-bc3c-edfb38f7ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.589005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a265da-fa27-43ce-bc3c-edfb38f7ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.595789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b59724-2364-4ffd-8d8d-33df095c7ac1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.629048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a2a265da-fa27-43ce-bc3c-edfb38f7ecc1 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:18.631274 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a2a265da-fa27-43ce-bc3c-edfb38f7ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:18.677520 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863b32f-6561-42ef-93e6-3ac63352dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.678747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863b32f-6561-42ef-93e6-3ac63352dd38 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.679168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863b32f-6561-42ef-93e6-3ac63352dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.679657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863b32f-6561-42ef-93e6-3ac63352dd38 admin admin] PATH_INFO: `/v3/projects/021ad5bdd093462e8b09e2aa9258fe5f/users/8a0f8e883a7e4c78a151084ac1977424/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.704236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863b32f-6561-42ef-93e6-3ac63352dd38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021ad5bdd093462e8b09e2aa9258fe5f, user_id=8a0f8e883a7e4c78a151084ac1977424, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:18.736712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863b32f-6561-42ef-93e6-3ac63352dd38 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:18.745448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 996/1990] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:18.759833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 995/1991] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:18 2021] PUT /identity/v3/projects/021ad5bdd093462e8b09e2aa9258fe5f/users/8a0f8e883a7e4c78a151084ac1977424/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:18.772066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a265da-fa27-43ce-bc3c-edfb38f7ecc1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:18.773720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b112a1-e4c6-4460-aaad-dd90d2e2261a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.774572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b112a1-e4c6-4460-aaad-dd90d2e2261a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.775050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b112a1-e4c6-4460-aaad-dd90d2e2261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.775163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a2a265da-fa27-43ce-bc3c-edfb38f7ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:18.839494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-64b112a1-e4c6-4460-aaad-dd90d2e2261a None None] MFA Rules not processed for user `8a0f8e883a7e4c78a151084ac1977424`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:18.840951 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-64b112a1-e4c6-4460-aaad-dd90d2e2261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:18.895457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a265da-fa27-43ce-bc3c-edfb38f7ecc1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:18.977707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c7df3-56cc-49b0-8efc-3228d7805288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:18.978891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c7df3-56cc-49b0-8efc-3228d7805288 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:18.979475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c7df3-56cc-49b0-8efc-3228d7805288 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:18.980053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c7df3-56cc-49b0-8efc-3228d7805288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:18.983096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 996/1992] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:18 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:18.988020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b112a1-e4c6-4460-aaad-dd90d2e2261a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.092007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b112a1-e4c6-4460-aaad-dd90d2e2261a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.098138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21ce24-6d92-48f6-8643-2c3d6e6c6320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.099020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21ce24-6d92-48f6-8643-2c3d6e6c6320 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.099343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21ce24-6d92-48f6-8643-2c3d6e6c6320 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.099747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21ce24-6d92-48f6-8643-2c3d6e6c6320 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.100569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21ce24-6d92-48f6-8643-2c3d6e6c6320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:19.116217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c7df3-56cc-49b0-8efc-3228d7805288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:19.134367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21ce24-6d92-48f6-8643-2c3d6e6c6320 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.185627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c7df3-56cc-49b0-8efc-3228d7805288 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.188394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 997/1993] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:18 2021] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:19.189414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21ce24-6d92-48f6-8643-2c3d6e6c6320 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.206954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 997/1994] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:19.314565 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21ce24-6d92-48f6-8643-2c3d6e6c6320 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.322108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4ceca-04e0-456a-84de-15587a291bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.323158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ceca-04e0-456a-84de-15587a291bac admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.323634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ceca-04e0-456a-84de-15587a291bac admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.324987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ceca-04e0-456a-84de-15587a291bac admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.326216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4ceca-04e0-456a-84de-15587a291bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:19.388374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4ceca-04e0-456a-84de-15587a291bac admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.422707 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 998/1995] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:19 2021] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:19.429182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c7df3-56cc-49b0-8efc-3228d7805288 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.447461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c7df3-56cc-49b0-8efc-3228d7805288 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.455764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c065-b57a-4443-9bfd-719419f5e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.457013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c065-b57a-4443-9bfd-719419f5e795 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.457547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c065-b57a-4443-9bfd-719419f5e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.458148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c065-b57a-4443-9bfd-719419f5e795 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.459501 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165c065-b57a-4443-9bfd-719419f5e795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:19.513486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165c065-b57a-4443-9bfd-719419f5e795 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.534659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 998/1996] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:19 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:19.540648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4ceca-04e0-456a-84de-15587a291bac admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.553401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4ceca-04e0-456a-84de-15587a291bac admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.559518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4670108-84ae-4e2c-bab4-89eac59edb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.561101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4670108-84ae-4e2c-bab4-89eac59edb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.561901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4670108-84ae-4e2c-bab4-89eac59edb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.562436 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4670108-84ae-4e2c-bab4-89eac59edb14 admin admin] PATH_INFO: `/v3/projects/0920ab4b1a194f66a10f71f39b6215a5/users/70860054837741988c62f51903fe15eb/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.592655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4670108-84ae-4e2c-bab4-89eac59edb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0920ab4b1a194f66a10f71f39b6215a5, user_id=70860054837741988c62f51903fe15eb, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:19.633413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4670108-84ae-4e2c-bab4-89eac59edb14 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.651740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 999/1997] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:19 2021] PUT /identity/v3/projects/0920ab4b1a194f66a10f71f39b6215a5/users/70860054837741988c62f51903fe15eb/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:19.657045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c065-b57a-4443-9bfd-719419f5e795 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.673038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c065-b57a-4443-9bfd-719419f5e795 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.779831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540070ab-4d32-44b4-851b-ad460d68acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.781026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540070ab-4d32-44b4-851b-ad460d68acdf admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.781642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540070ab-4d32-44b4-851b-ad460d68acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.782264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540070ab-4d32-44b4-851b-ad460d68acdf admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.783310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540070ab-4d32-44b4-851b-ad460d68acdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:19.819387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540070ab-4d32-44b4-851b-ad460d68acdf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.832538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 999/1998] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:19 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:19.837936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4670108-84ae-4e2c-bab4-89eac59edb14 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.852762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4670108-84ae-4e2c-bab4-89eac59edb14 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.861571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540070ab-4d32-44b4-851b-ad460d68acdf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.863358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-540070ab-4d32-44b4-851b-ad460d68acdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:19.866503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98034e-b230-4a8c-b389-fb1f4c4d09d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.869753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98034e-b230-4a8c-b389-fb1f4c4d09d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.870323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98034e-b230-4a8c-b389-fb1f4c4d09d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.870856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98034e-b230-4a8c-b389-fb1f4c4d09d9 admin admin] PATH_INFO: `/v3/projects/0920ab4b1a194f66a10f71f39b6215a5/users/70860054837741988c62f51903fe15eb/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.876725 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98034e-b230-4a8c-b389-fb1f4c4d09d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0920ab4b1a194f66a10f71f39b6215a5, user_id=70860054837741988c62f51903fe15eb, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:19.882747 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540070ab-4d32-44b4-851b-ad460d68acdf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:19.891176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:19.892612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:19.893136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:19.893643 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] PATH_INFO: `/v3/projects/ecbb2669861b49ac96a3f2538e65f9db` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:19.895735 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbb2669861b49ac96a3f2538e65f9db)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:19.906019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98034e-b230-4a8c-b389-fb1f4c4d09d9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:19.918036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1000/1999] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:19 2021] PUT /identity/v3/projects/0920ab4b1a194f66a10f71f39b6215a5/users/70860054837741988c62f51903fe15eb/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:19.922706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98034e-b230-4a8c-b389-fb1f4c4d09d9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:19.956656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:20.057834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98034e-b230-4a8c-b389-fb1f4c4d09d9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:20.061096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbb2669861b49ac96a3f2538e65f9db', 'request_id': 'req-33701961-55df-42db-8e74-cc1dbf33c3b4'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:20.076808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbb2669861b49ac96a3f2538e65f9db', 'request_id': 'req-33701961-55df-42db-8e74-cc1dbf33c3b4'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:20.087143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbb2669861b49ac96a3f2538e65f9db', 'request_id': 'req-33701961-55df-42db-8e74-cc1dbf33c3b4'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:20.102141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] The token cache is being invalidate because project ecbb2669861b49ac96a3f2538e65f9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:20.102585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:20.103467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:20.120554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1000/2000] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:19 2021] DELETE /identity/v3/projects/ecbb2669861b49ac96a3f2538e65f9db => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:20.241623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a5b27-a988-41ab-9af4-55035fca3ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:20.243545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5b27-a988-41ab-9af4-55035fca3ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:20.243828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5b27-a988-41ab-9af4-55035fca3ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:20.244305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5b27-a988-41ab-9af4-55035fca3ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:20.246976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a5b27-a988-41ab-9af4-55035fca3ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:20.311433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a5b27-a988-41ab-9af4-55035fca3ed9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:20.346251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1001/2001] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:19 2021] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:20.348632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:20.350218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:20.382798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33701961-55df-42db-8e74-cc1dbf33c3b4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:20.397756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cf59c-0f8c-4113-abe3-532f59a3a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:20.398991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cf59c-0f8c-4113-abe3-532f59a3a5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:20.399468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cf59c-0f8c-4113-abe3-532f59a3a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:20.399955 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cf59c-0f8c-4113-abe3-532f59a3a5bb admin admin] PATH_INFO: `/v3/projects/0920ab4b1a194f66a10f71f39b6215a5/users/70860054837741988c62f51903fe15eb/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:20.403744 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cf59c-0f8c-4113-abe3-532f59a3a5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0920ab4b1a194f66a10f71f39b6215a5, user_id=70860054837741988c62f51903fe15eb, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:20.458331 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cf59c-0f8c-4113-abe3-532f59a3a5bb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:20.481544 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1001/2002] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:20 2021] PUT /identity/v3/projects/0920ab4b1a194f66a10f71f39b6215a5/users/70860054837741988c62f51903fe15eb/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:20.494910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2242-25df-48ab-962d-4812523659e2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:20.495200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2242-25df-48ab-962d-4812523659e2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:20.495488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2242-25df-48ab-962d-4812523659e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:20.557870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-da4d2242-25df-48ab-962d-4812523659e2 None None] MFA Rules not processed for user `70860054837741988c62f51903fe15eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:20.560305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-da4d2242-25df-48ab-962d-4812523659e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:20.661157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1002/2003] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:20 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:20.671783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cf59c-0f8c-4113-abe3-532f59a3a5bb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:20.673935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9e5cf59c-0f8c-4113-abe3-532f59a3a5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:20.761291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cf59c-0f8c-4113-abe3-532f59a3a5bb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:20.765746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2ff83-f022-40f0-b229-56b3a63af0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:20.766447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2ff83-f022-40f0-b229-56b3a63af0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:20.766778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2ff83-f022-40f0-b229-56b3a63af0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:20.767094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2ff83-f022-40f0-b229-56b3a63af0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:20.778576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2ff83-f022-40f0-b229-56b3a63af0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:20.805633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2ff83-f022-40f0-b229-56b3a63af0c1 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:20.817411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1002/2004] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:20 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:21.694582 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2242-25df-48ab-962d-4812523659e2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:21.696507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-da4d2242-25df-48ab-962d-4812523659e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:21.722429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2242-25df-48ab-962d-4812523659e2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:21.731234 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:21.734275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:21.734867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:21.736672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:21.740887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:21.881761 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:21.933140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:21.952831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1003/2005] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:21 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:30.003366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2ff83-f022-40f0-b229-56b3a63af0c1 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:30.021037 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2ff83-f022-40f0-b229-56b3a63af0c1 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:30.029556 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57fb0a-f2b6-41da-bb13-38c25e4829c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:30.031090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57fb0a-f2b6-41da-bb13-38c25e4829c4 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:30.031905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57fb0a-f2b6-41da-bb13-38c25e4829c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:30.032473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57fb0a-f2b6-41da-bb13-38c25e4829c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:30.035932 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ef57fb0a-f2b6-41da-bb13-38c25e4829c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:30.227119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57fb0a-f2b6-41da-bb13-38c25e4829c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:30.281804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57fb0a-f2b6-41da-bb13-38c25e4829c4 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:30.298393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1003/2006] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:30 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:31.907504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:31.909304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:32.034655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b8c4-c1db-48d2-9058-283a2c7adf25 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:32.040966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:32.041971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.042688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.043076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] PATH_INFO: `/v3/users/7fd015c070a543d688b06d5c2650d486` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.045346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd015c070a543d688b06d5c2650d486)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:32.071411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:32.148612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd015c070a543d688b06d5c2650d486'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:32.166233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd015c070a543d688b06d5c2650d486'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:32.167449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd015c070a543d688b06d5c2650d486'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:32.181210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd015c070a543d688b06d5c2650d486'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:32.198422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd015c070a543d688b06d5c2650d486'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:32.209716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1004/2007] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:31 2021] DELETE /identity/v3/users/7fd015c070a543d688b06d5c2650d486 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:32.214792 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d27b2-4775-4e8c-bca5-b894a2cf162c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.215580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d27b2-4775-4e8c-bca5-b894a2cf162c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.215580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d27b2-4775-4e8c-bca5-b894a2cf162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.245751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6a7d27b2-4775-4e8c-bca5-b894a2cf162c None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:32.247271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6a7d27b2-4775-4e8c-bca5-b894a2cf162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:32.377975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1004/2008] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:32.396902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:32.399483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:32.484500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c453f55-9b6d-462c-9f55-74da65c4447e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:32.488630 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67489e-c5be-434d-881d-0c9fe7c5eb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:32.489428 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67489e-c5be-434d-881d-0c9fe7c5eb61 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:32.489770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67489e-c5be-434d-881d-0c9fe7c5eb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:32.490130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67489e-c5be-434d-881d-0c9fe7c5eb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:32.501661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67489e-c5be-434d-881d-0c9fe7c5eb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:32.529981 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67489e-c5be-434d-881d-0c9fe7c5eb61 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:32.541206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1005/2009] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:33.196532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d27b2-4775-4e8c-bca5-b894a2cf162c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:33.198033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6a7d27b2-4775-4e8c-bca5-b894a2cf162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:33.280387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d27b2-4775-4e8c-bca5-b894a2cf162c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:33.285983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:33.287129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:33.287692 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:33.288060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] PATH_INFO: `/v3/projects/568bf2d67c774d5cbd81d2cbbfa4e1cc` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:33.289553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=568bf2d67c774d5cbd81d2cbbfa4e1cc)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:33.320030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:33.383570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568bf2d67c774d5cbd81d2cbbfa4e1cc', 'request_id': 'req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.407851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568bf2d67c774d5cbd81d2cbbfa4e1cc', 'request_id': 'req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.420161 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568bf2d67c774d5cbd81d2cbbfa4e1cc', 'request_id': 'req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.438207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] The token cache is being invalidate because project 568bf2d67c774d5cbd81d2cbbfa4e1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:33.438694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.439508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.442204 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1005/2010] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:33 2021] DELETE /identity/v3/projects/568bf2d67c774d5cbd81d2cbbfa4e1cc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:33.448717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67489e-c5be-434d-881d-0c9fe7c5eb61 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:33.531556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67489e-c5be-434d-881d-0c9fe7c5eb61 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:33.624554 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:33.626072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:33.626578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:33.627146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] PATH_INFO: `/v3/users/1285bf2b40904d24ad796261f2762906` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:33.629250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1285bf2b40904d24ad796261f2762906)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:33.681569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:33.750104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1285bf2b40904d24ad796261f2762906'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.760457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1285bf2b40904d24ad796261f2762906'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.761763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1285bf2b40904d24ad796261f2762906'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.772585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1285bf2b40904d24ad796261f2762906'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.788328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-adf0d94c-0ff5-4c46-b182-9c7e1877e4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1285bf2b40904d24ad796261f2762906'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:33.795642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1006/2011] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:33 2021] DELETE /identity/v3/users/1285bf2b40904d24ad796261f2762906 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:34.437162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:34.439129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:34.509114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388bdbf-6f24-41de-b4e9-ff377a75c5fc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:34.604093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:34.605058 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:34.605405 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:34.605699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] PATH_INFO: `/v3/projects/3b02e727e9284148b9648cc8f69a9070` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:34.607403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b02e727e9284148b9648cc8f69a9070)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:34.638846 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:34.718474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b02e727e9284148b9648cc8f69a9070', 'request_id': 'req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:34.738707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b02e727e9284148b9648cc8f69a9070', 'request_id': 'req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:34.752498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b02e727e9284148b9648cc8f69a9070', 'request_id': 'req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:34.771266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] The token cache is being invalidate because project 3b02e727e9284148b9648cc8f69a9070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:34.771903 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:34.773044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-28e7bca0-38bc-4b77-9d1b-a79acc45a53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:34.775236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1006/2012] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:34 2021] DELETE /identity/v3/projects/3b02e727e9284148b9648cc8f69a9070 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:34.783211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a926c-6217-48c5-b9c7-7d2595f61252 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:34.784904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a926c-6217-48c5-b9c7-7d2595f61252 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:34.784904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a926c-6217-48c5-b9c7-7d2595f61252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:34.906952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d92a926c-6217-48c5-b9c7-7d2595f61252 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:34.908166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d92a926c-6217-48c5-b9c7-7d2595f61252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:35.047827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1007/2013] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:35.056587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31485f-b316-453d-a692-d064fd1f528f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.057378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31485f-b316-453d-a692-d064fd1f528f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.058088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31485f-b316-453d-a692-d064fd1f528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.089165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-cf31485f-b316-453d-a692-d064fd1f528f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:35.091359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-cf31485f-b316-453d-a692-d064fd1f528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:35.103957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1007/2014] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:35.111040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a926c-6217-48c5-b9c7-7d2595f61252 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:35.131572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a926c-6217-48c5-b9c7-7d2595f61252 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:35.141086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f3efe-a657-4b2d-98c0-e1ac5b834ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:35.142460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f3efe-a657-4b2d-98c0-e1ac5b834ebe admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.143211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f3efe-a657-4b2d-98c0-e1ac5b834ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.143719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f3efe-a657-4b2d-98c0-e1ac5b834ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.145276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f3efe-a657-4b2d-98c0-e1ac5b834ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:35.146154 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f3efe-a657-4b2d-98c0-e1ac5b834ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:35.199116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f3efe-a657-4b2d-98c0-e1ac5b834ebe admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:35.221425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1008/2015] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:35.228639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31485f-b316-453d-a692-d064fd1f528f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:35.244540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31485f-b316-453d-a692-d064fd1f528f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:35.250642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fe236-788e-461e-bab2-ace872d2a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:35.251367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fe236-788e-461e-bab2-ace872d2a46b admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.251667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fe236-788e-461e-bab2-ace872d2a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.251964 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fe236-788e-461e-bab2-ace872d2a46b admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.252639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fe236-788e-461e-bab2-ace872d2a46b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:35.281401 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fe236-788e-461e-bab2-ace872d2a46b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:35.331033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1008/2016] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:35 2021] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:35.336495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f3efe-a657-4b2d-98c0-e1ac5b834ebe admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:35.351500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f3efe-a657-4b2d-98c0-e1ac5b834ebe admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:35.435811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c069660-cccb-49b6-8a8c-c6fb0d63e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:35.436685 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069660-cccb-49b6-8a8c-c6fb0d63e1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.437203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069660-cccb-49b6-8a8c-c6fb0d63e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.437629 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069660-cccb-49b6-8a8c-c6fb0d63e1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.438531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c069660-cccb-49b6-8a8c-c6fb0d63e1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:35.473321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c069660-cccb-49b6-8a8c-c6fb0d63e1c0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:35.507976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1009/2017] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:35 2021] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:35.509482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fe236-788e-461e-bab2-ace872d2a46b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:35.534559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fe236-788e-461e-bab2-ace872d2a46b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:35.551438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b38b6a-cdf1-4600-b70c-1b3467720419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:35.552944 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38b6a-cdf1-4600-b70c-1b3467720419 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.553678 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38b6a-cdf1-4600-b70c-1b3467720419 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.554388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38b6a-cdf1-4600-b70c-1b3467720419 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.555731 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b38b6a-cdf1-4600-b70c-1b3467720419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:35.609378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b38b6a-cdf1-4600-b70c-1b3467720419 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:35.626349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1009/2018] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:35 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:35.631580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c069660-cccb-49b6-8a8c-c6fb0d63e1c0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:35.645107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c069660-cccb-49b6-8a8c-c6fb0d63e1c0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:35.650323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6ee0-12c2-4e63-8ad5-b88d2de64b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:35.651783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6ee0-12c2-4e63-8ad5-b88d2de64b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.651989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6ee0-12c2-4e63-8ad5-b88d2de64b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.652445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6ee0-12c2-4e63-8ad5-b88d2de64b14 admin admin] PATH_INFO: `/v3/projects/d943391cffcc42cda8c4c74567362b31/users/9ec54344470d44e0beac589c9674b053/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.684705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b6ee0-12c2-4e63-8ad5-b88d2de64b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d943391cffcc42cda8c4c74567362b31, user_id=9ec54344470d44e0beac589c9674b053, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:35.727513 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b6ee0-12c2-4e63-8ad5-b88d2de64b14 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:35.758477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1010/2019] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:35 2021] PUT /identity/v3/projects/d943391cffcc42cda8c4c74567362b31/users/9ec54344470d44e0beac589c9674b053/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:35.779922 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282ecc0-98a2-45c6-b616-0e816cafaeb4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:35.780903 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282ecc0-98a2-45c6-b616-0e816cafaeb4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:35.782064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282ecc0-98a2-45c6-b616-0e816cafaeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:35.853015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a282ecc0-98a2-45c6-b616-0e816cafaeb4 None None] MFA Rules not processed for user `9ec54344470d44e0beac589c9674b053`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:35.854841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a282ecc0-98a2-45c6-b616-0e816cafaeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:36.024742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1010/2020] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:35 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:36.032819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6ee0-12c2-4e63-8ad5-b88d2de64b14 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.183670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6ee0-12c2-4e63-8ad5-b88d2de64b14 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.192331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745041ff-07b8-48a4-8e44-c0cd21c4f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.193541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745041ff-07b8-48a4-8e44-c0cd21c4f7ad admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.194160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745041ff-07b8-48a4-8e44-c0cd21c4f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.194764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745041ff-07b8-48a4-8e44-c0cd21c4f7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.196016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745041ff-07b8-48a4-8e44-c0cd21c4f7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:36.257554 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745041ff-07b8-48a4-8e44-c0cd21c4f7ad admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.321309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1011/2021] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:36 2021] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:36.329707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282ecc0-98a2-45c6-b616-0e816cafaeb4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.351225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282ecc0-98a2-45c6-b616-0e816cafaeb4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.492195 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670ee43-099a-4f5f-8651-51e7394433de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.493288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ee43-099a-4f5f-8651-51e7394433de admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.494177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ee43-099a-4f5f-8651-51e7394433de admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.494775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ee43-099a-4f5f-8651-51e7394433de admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.496091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670ee43-099a-4f5f-8651-51e7394433de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:36.553302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670ee43-099a-4f5f-8651-51e7394433de admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.588384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1011/2022] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:36 2021] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:36.595842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745041ff-07b8-48a4-8e44-c0cd21c4f7ad admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.630789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745041ff-07b8-48a4-8e44-c0cd21c4f7ad admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.637030 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f506-743d-4b25-9630-ca8f01013e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.638111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f506-743d-4b25-9630-ca8f01013e27 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.638604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f506-743d-4b25-9630-ca8f01013e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.639303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f506-743d-4b25-9630-ca8f01013e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.640590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f506-743d-4b25-9630-ca8f01013e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:36.695545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f506-743d-4b25-9630-ca8f01013e27 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.728569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1012/2023] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:36.735671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670ee43-099a-4f5f-8651-51e7394433de admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.756836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670ee43-099a-4f5f-8651-51e7394433de admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:36.766654 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14706952-5796-40f0-ad62-67dbb9e8363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:36.768620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14706952-5796-40f0-ad62-67dbb9e8363d admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:36.769425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14706952-5796-40f0-ad62-67dbb9e8363d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:36.769978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14706952-5796-40f0-ad62-67dbb9e8363d admin admin] PATH_INFO: `/v3/projects/ee92104c39da4f208328003a2052c23e/users/cf4bd9353d714a8492e01b446ba64c8f/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:36.819585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14706952-5796-40f0-ad62-67dbb9e8363d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee92104c39da4f208328003a2052c23e, user_id=cf4bd9353d714a8492e01b446ba64c8f, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:36.888311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14706952-5796-40f0-ad62-67dbb9e8363d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:36.931615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1012/2024] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:36 2021] PUT /identity/v3/projects/ee92104c39da4f208328003a2052c23e/users/cf4bd9353d714a8492e01b446ba64c8f/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:36.943826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f506-743d-4b25-9630-ca8f01013e27 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:36.979871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f506-743d-4b25-9630-ca8f01013e27 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:37.195844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bc656-6b99-4e31-b154-146e49866331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:37.202834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bc656-6b99-4e31-b154-146e49866331 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:37.207051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bc656-6b99-4e31-b154-146e49866331 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:37.208358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bc656-6b99-4e31-b154-146e49866331 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:37.209965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bc656-6b99-4e31-b154-146e49866331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:37.264277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bc656-6b99-4e31-b154-146e49866331 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:37.285780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1013/2025] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:37.293197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14706952-5796-40f0-ad62-67dbb9e8363d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:37.334854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14706952-5796-40f0-ad62-67dbb9e8363d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:37.345408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8da9d-cb55-44eb-9531-5a5a66604e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:37.347612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8da9d-cb55-44eb-9531-5a5a66604e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:37.348523 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8da9d-cb55-44eb-9531-5a5a66604e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:37.349018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8da9d-cb55-44eb-9531-5a5a66604e0f admin admin] PATH_INFO: `/v3/projects/ee92104c39da4f208328003a2052c23e/users/cf4bd9353d714a8492e01b446ba64c8f/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:37.352818 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8da9d-cb55-44eb-9531-5a5a66604e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee92104c39da4f208328003a2052c23e, user_id=cf4bd9353d714a8492e01b446ba64c8f, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:37.415751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8da9d-cb55-44eb-9531-5a5a66604e0f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:37.458220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1013/2026] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:37 2021] PUT /identity/v3/projects/ee92104c39da4f208328003a2052c23e/users/cf4bd9353d714a8492e01b446ba64c8f/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:37.460135 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bc656-6b99-4e31-b154-146e49866331 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:37.482016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bc656-6b99-4e31-b154-146e49866331 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:37.638477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea9ab3-6673-4eec-8d35-3a086f01ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:37.639879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea9ab3-6673-4eec-8d35-3a086f01ba0e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:37.640614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea9ab3-6673-4eec-8d35-3a086f01ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:37.641570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea9ab3-6673-4eec-8d35-3a086f01ba0e admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:37.643583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea9ab3-6673-4eec-8d35-3a086f01ba0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:37.700039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea9ab3-6673-4eec-8d35-3a086f01ba0e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:37.722912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1014/2027] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:37 2021] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:39:37.729175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8da9d-cb55-44eb-9531-5a5a66604e0f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:37.748194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8da9d-cb55-44eb-9531-5a5a66604e0f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:37.755794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca789e74-e2c6-4aa0-a3c1-f1d8b8c6bbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:37.757392 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca789e74-e2c6-4aa0-a3c1-f1d8b8c6bbde admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:37.757947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca789e74-e2c6-4aa0-a3c1-f1d8b8c6bbde admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:37.758460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca789e74-e2c6-4aa0-a3c1-f1d8b8c6bbde admin admin] PATH_INFO: `/v3/projects/ee92104c39da4f208328003a2052c23e/users/cf4bd9353d714a8492e01b446ba64c8f/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:37.761907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca789e74-e2c6-4aa0-a3c1-f1d8b8c6bbde admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee92104c39da4f208328003a2052c23e, user_id=cf4bd9353d714a8492e01b446ba64c8f, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:37.819981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca789e74-e2c6-4aa0-a3c1-f1d8b8c6bbde admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:37.843262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1014/2028] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:37 2021] PUT /identity/v3/projects/ee92104c39da4f208328003a2052c23e/users/cf4bd9353d714a8492e01b446ba64c8f/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:37.857756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bcdef-9980-434c-b52e-0d62c8765081 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:37.858785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bcdef-9980-434c-b52e-0d62c8765081 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:37.859639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bcdef-9980-434c-b52e-0d62c8765081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:37.932512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-282bcdef-9980-434c-b52e-0d62c8765081 None None] MFA Rules not processed for user `cf4bd9353d714a8492e01b446ba64c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:37.934265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-282bcdef-9980-434c-b52e-0d62c8765081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:38.071640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1015/2029] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:37 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:38.088307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca789e74-e2c6-4aa0-a3c1-f1d8b8c6bbde admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:38.090353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ca789e74-e2c6-4aa0-a3c1-f1d8b8c6bbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:38.356273 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca789e74-e2c6-4aa0-a3c1-f1d8b8c6bbde admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:38.369639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9f9b0-9863-426b-a2bc-2a1d20367536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:38.370076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9f9b0-9863-426b-a2bc-2a1d20367536 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:38.371617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9f9b0-9863-426b-a2bc-2a1d20367536 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:38.372446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9f9b0-9863-426b-a2bc-2a1d20367536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:38.380383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bcdef-9980-434c-b52e-0d62c8765081 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:38.383999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-282bcdef-9980-434c-b52e-0d62c8765081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:38.406442 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9f9b0-9863-426b-a2bc-2a1d20367536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:38.439219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9f9b0-9863-426b-a2bc-2a1d20367536 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:38.463082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1015/2030] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:38 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:38.557978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9f9b0-9863-426b-a2bc-2a1d20367536 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:38.572237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9f9b0-9863-426b-a2bc-2a1d20367536 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:38.593423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:38.594385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:38.594812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:38.595092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] PATH_INFO: `/v3/users/9ec54344470d44e0beac589c9674b053` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:38.596388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bcdef-9980-434c-b52e-0d62c8765081 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:38.597933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec54344470d44e0beac589c9674b053)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:38.611248 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:38.612112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:38.612425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:38.612705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] PATH_INFO: `/v3/users/cd17de7dc438494686f97471d1a32674` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:38.613950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd17de7dc438494686f97471d1a32674)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:38.647577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:38.697782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:38.796984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec54344470d44e0beac589c9674b053'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.812242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd17de7dc438494686f97471d1a32674'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.834070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec54344470d44e0beac589c9674b053'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.836196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd17de7dc438494686f97471d1a32674'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.837654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd17de7dc438494686f97471d1a32674'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.850504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec54344470d44e0beac589c9674b053'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.855672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec54344470d44e0beac589c9674b053'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.864850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd17de7dc438494686f97471d1a32674'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.877868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-39bdb423-2ae2-440a-80f2-db16138de825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec54344470d44e0beac589c9674b053'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.887361 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1016/2031] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:38 2021] DELETE /identity/v3/users/9ec54344470d44e0beac589c9674b053 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:38.894360 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce6746-73e9-4f71-b341-6930813b600d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:38.894630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce6746-73e9-4f71-b341-6930813b600d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:38.894845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce6746-73e9-4f71-b341-6930813b600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:38.919045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c1e0ffa-f8e2-4f7d-a822-801b2da46e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd17de7dc438494686f97471d1a32674'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:38.935355 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1016/2032] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:38 2021] DELETE /identity/v3/users/cd17de7dc438494686f97471d1a32674 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:38.937014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba0218-1f36-43ba-b27d-9a80243e6e1e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:38.937348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba0218-1f36-43ba-b27d-9a80243e6e1e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:38.937639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba0218-1f36-43ba-b27d-9a80243e6e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:38.946840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-ccce6746-73e9-4f71-b341-6930813b600d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:38.948845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ccce6746-73e9-4f71-b341-6930813b600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:38.965843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b8ba0218-1f36-43ba-b27d-9a80243e6e1e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:38.967640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b8ba0218-1f36-43ba-b27d-9a80243e6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:39.076634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1017/2033] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:39.090556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba0218-1f36-43ba-b27d-9a80243e6e1e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:39.094270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b8ba0218-1f36-43ba-b27d-9a80243e6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:39.126816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1017/2034] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:39.143159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce6746-73e9-4f71-b341-6930813b600d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:39.146801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ccce6746-73e9-4f71-b341-6930813b600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:39.302315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba0218-1f36-43ba-b27d-9a80243e6e1e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:39.308868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2b7a-b847-4bdc-97d2-537ceb436429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:39.309277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2b7a-b847-4bdc-97d2-537ceb436429 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:39.309713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2b7a-b847-4bdc-97d2-537ceb436429 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:39.310250 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2b7a-b847-4bdc-97d2-537ceb436429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:39.313364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce6746-73e9-4f71-b341-6930813b600d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:39.324838 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb2b7a-b847-4bdc-97d2-537ceb436429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:39.326806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb737ed-e0cd-4050-b223-3a0c53e9565e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:39.327788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb737ed-e0cd-4050-b223-3a0c53e9565e service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:39.328487 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb737ed-e0cd-4050-b223-3a0c53e9565e service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:39.329029 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb737ed-e0cd-4050-b223-3a0c53e9565e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:39.357970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb737ed-e0cd-4050-b223-3a0c53e9565e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:39.387664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb2b7a-b847-4bdc-97d2-537ceb436429 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:39.411660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1018/2035] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:39.433795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb737ed-e0cd-4050-b223-3a0c53e9565e service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:39.459637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1018/2036] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:40.364188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2b7a-b847-4bdc-97d2-537ceb436429 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:40.366820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e5fb2b7a-b847-4bdc-97d2-537ceb436429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:40.395723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2b7a-b847-4bdc-97d2-537ceb436429 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:40.407274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:40.424313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:40.425301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:40.426180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] PATH_INFO: `/v3/users/108e1d33249b49dcb6e3779514bc7a9b` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:40.428972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108e1d33249b49dcb6e3779514bc7a9b)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:40.456041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb737ed-e0cd-4050-b223-3a0c53e9565e service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:40.458473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0fb737ed-e0cd-4050-b223-3a0c53e9565e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:40.506080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:40.511297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb737ed-e0cd-4050-b223-3a0c53e9565e service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:40.531017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:40.535197 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:40.536248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:40.537042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] PATH_INFO: `/v3/projects/d943391cffcc42cda8c4c74567362b31` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:40.539508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d943391cffcc42cda8c4c74567362b31)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:40.597462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:40.603780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108e1d33249b49dcb6e3779514bc7a9b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.623392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108e1d33249b49dcb6e3779514bc7a9b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.624339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108e1d33249b49dcb6e3779514bc7a9b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.638288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108e1d33249b49dcb6e3779514bc7a9b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.666025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108e1d33249b49dcb6e3779514bc7a9b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.678816 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1019/2037] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:40 2021] DELETE /identity/v3/users/108e1d33249b49dcb6e3779514bc7a9b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:40.680719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:40.683284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:40.730947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd943391cffcc42cda8c4c74567362b31', 'request_id': 'req-9562b5f8-a850-430a-be81-4045e6cb12fc'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.748952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd943391cffcc42cda8c4c74567362b31', 'request_id': 'req-9562b5f8-a850-430a-be81-4045e6cb12fc'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.759994 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd943391cffcc42cda8c4c74567362b31', 'request_id': 'req-9562b5f8-a850-430a-be81-4045e6cb12fc'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.794797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] The token cache is being invalidate because project d943391cffcc42cda8c4c74567362b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:40.794797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.796001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:40.799900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1019/2038] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:40 2021] DELETE /identity/v3/projects/d943391cffcc42cda8c4c74567362b31 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:40.806566 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:40.808578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:40.958836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29b52-afbb-4dc2-848e-ffa8d3153024 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:40.959096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b5f8-a850-430a-be81-4045e6cb12fc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:40.966104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:40.967936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:40.968097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:40.968541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:40.969050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] PATH_INFO: `/v3/projects/22ee941b0b3c40338845033ede89635d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:40.969649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:40.970112 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:40.970599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] PATH_INFO: `/v3/users/cf4bd9353d714a8492e01b446ba64c8f` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:40.971608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ee941b0b3c40338845033ede89635d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:40.972981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4bd9353d714a8492e01b446ba64c8f)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:41.038776 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:41.052340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:41.203384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ee941b0b3c40338845033ede89635d', 'request_id': 'req-3b331f71-a1a8-41b2-9166-356f118e8377'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.251994 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4bd9353d714a8492e01b446ba64c8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.276414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ee941b0b3c40338845033ede89635d', 'request_id': 'req-3b331f71-a1a8-41b2-9166-356f118e8377'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.310723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ee941b0b3c40338845033ede89635d', 'request_id': 'req-3b331f71-a1a8-41b2-9166-356f118e8377'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.330212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4bd9353d714a8492e01b446ba64c8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.355521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4bd9353d714a8492e01b446ba64c8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.366777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4bd9353d714a8492e01b446ba64c8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.375086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] The token cache is being invalidate because project 22ee941b0b3c40338845033ede89635d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:41.376558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.379515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4bd9353d714a8492e01b446ba64c8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.380179 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.389758 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1020/2039] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:40 2021] DELETE /identity/v3/projects/22ee941b0b3c40338845033ede89635d => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:41.397483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:41.409056 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1020/2040] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:40 2021] DELETE /identity/v3/users/cf4bd9353d714a8492e01b446ba64c8f => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:41.409265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:41.539206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:41.541538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:41.648190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b331f71-a1a8-41b2-9166-356f118e8377 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:41.689189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fde376-944b-46ef-81b4-557a10a41232 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:41.727317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:41.731029 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:41.731560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:41.734935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] PATH_INFO: `/v3/projects/bb69c5ffb21a48ba9f80a543e763d5d4` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:41.742723 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb69c5ffb21a48ba9f80a543e763d5d4)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:41.746422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:41.748516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:41.748867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:41.750078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] PATH_INFO: `/v3/users/8a0f8e883a7e4c78a151084ac1977424` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:41.752325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0f8e883a7e4c78a151084ac1977424)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:41.804086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:41.825791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:41.911684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'request_id': 'req-ba78e27d-a728-4c5f-b571-7ddc588e0eac'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.926913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0f8e883a7e4c78a151084ac1977424'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.930356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'request_id': 'req-ba78e27d-a728-4c5f-b571-7ddc588e0eac'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.944804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb69c5ffb21a48ba9f80a543e763d5d4', 'request_id': 'req-ba78e27d-a728-4c5f-b571-7ddc588e0eac'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.953435 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0f8e883a7e4c78a151084ac1977424'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.954792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0f8e883a7e4c78a151084ac1977424'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.966885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] The token cache is being invalidate because project bb69c5ffb21a48ba9f80a543e763d5d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:41.967408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.968340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ba78e27d-a728-4c5f-b571-7ddc588e0eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.971549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1021/2041] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:41 2021] DELETE /identity/v3/projects/bb69c5ffb21a48ba9f80a543e763d5d4 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:41.974217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0f8e883a7e4c78a151084ac1977424'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:41.980391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0451-de4e-4a1a-aa64-38407268b577 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:41.981725 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0451-de4e-4a1a-aa64-38407268b577 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:41.983832 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0451-de4e-4a1a-aa64-38407268b577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:42.015101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-14a81eb6-78b8-4bae-88f7-78eae98c118b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0f8e883a7e4c78a151084ac1977424'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:42.030198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1021/2042] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:41 2021] DELETE /identity/v3/users/8a0f8e883a7e4c78a151084ac1977424 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:42.043500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b1cf0451-de4e-4a1a-aa64-38407268b577 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:42.046865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b1cf0451-de4e-4a1a-aa64-38407268b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:42.231984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1022/2043] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:42.249253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89231f9-2f85-4307-a17f-dea0b48f5b50 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:42.249794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89231f9-2f85-4307-a17f-dea0b48f5b50 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:42.250604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89231f9-2f85-4307-a17f-dea0b48f5b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:42.323326 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d89231f9-2f85-4307-a17f-dea0b48f5b50 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:42.326429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d89231f9-2f85-4307-a17f-dea0b48f5b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:42.343632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1022/2044] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:42.350569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0451-de4e-4a1a-aa64-38407268b577 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:42.379683 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0451-de4e-4a1a-aa64-38407268b577 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:42.398408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:42.399554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:42.400512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:42.401024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:42.401939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:42.406135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:42.442947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:42.483751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1023/2045] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:42.489004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89231f9-2f85-4307-a17f-dea0b48f5b50 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:42.521902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89231f9-2f85-4307-a17f-dea0b48f5b50 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:42.522325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:42.529266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:42.532194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438bccc-6974-4a32-bec3-534783ee3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:42.533334 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438bccc-6974-4a32-bec3-534783ee3364 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:42.534800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438bccc-6974-4a32-bec3-534783ee3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:42.535771 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438bccc-6974-4a32-bec3-534783ee3364 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:42.537230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438bccc-6974-4a32-bec3-534783ee3364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:42.559569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f2f1c-e85e-413c-9968-840dc50ba8bb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:42.566503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:42.567835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:42.568349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:42.568771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] PATH_INFO: `/v3/projects/ee92104c39da4f208328003a2052c23e` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:42.570659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee92104c39da4f208328003a2052c23e)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:42.610677 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438bccc-6974-4a32-bec3-534783ee3364 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:42.620543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:42.714258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1023/2046] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:42 2021] POST /identity/v3/projects => generated 391 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:42.722794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438bccc-6974-4a32-bec3-534783ee3364 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:42.834063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee92104c39da4f208328003a2052c23e', 'request_id': 'req-0a82ee45-95ed-45e5-9255-f5ec82c2a654'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:42.906459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee92104c39da4f208328003a2052c23e', 'request_id': 'req-0a82ee45-95ed-45e5-9255-f5ec82c2a654'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:42.936219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee92104c39da4f208328003a2052c23e', 'request_id': 'req-0a82ee45-95ed-45e5-9255-f5ec82c2a654'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:42.999337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] The token cache is being invalidate because project ee92104c39da4f208328003a2052c23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:42.999781 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.004426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-0a82ee45-95ed-45e5-9255-f5ec82c2a654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.007300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1024/2047] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:42 2021] DELETE /identity/v3/projects/ee92104c39da4f208328003a2052c23e => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:43.025252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2637d-1239-4365-b0a5-94a943310529 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.025642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2637d-1239-4365-b0a5-94a943310529 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.026041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2637d-1239-4365-b0a5-94a943310529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.056528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438bccc-6974-4a32-bec3-534783ee3364 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:43.077335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6ac2637d-1239-4365-b0a5-94a943310529 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:43.079311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6ac2637d-1239-4365-b0a5-94a943310529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.257705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc82173-9a23-4da0-9f93-6f67c7426436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:43.258220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc82173-9a23-4da0-9f93-6f67c7426436 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.258531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc82173-9a23-4da0-9f93-6f67c7426436 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.258901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc82173-9a23-4da0-9f93-6f67c7426436 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.259694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc82173-9a23-4da0-9f93-6f67c7426436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:43.289014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc82173-9a23-4da0-9f93-6f67c7426436 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:43.292271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1025/2048] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:43.309519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccfd3a-9ff2-4c17-a63d-40673f50ef58 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.309695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccfd3a-9ff2-4c17-a63d-40673f50ef58 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.313160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccfd3a-9ff2-4c17-a63d-40673f50ef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.334806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1024/2049] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:42 2021] POST /identity/v3/users => generated 296 bytes in 614 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:43.335804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc82173-9a23-4da0-9f93-6f67c7426436 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:43.337652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-6fc82173-9a23-4da0-9f93-6f67c7426436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.357544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc82173-9a23-4da0-9f93-6f67c7426436 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:43.361057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5fccfd3a-9ff2-4c17-a63d-40673f50ef58 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:43.362341 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5fccfd3a-9ff2-4c17-a63d-40673f50ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.363749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3bda-219f-4576-9e71-5edad3e0a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:43.364718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3bda-219f-4576-9e71-5edad3e0a516 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.365191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3bda-219f-4576-9e71-5edad3e0a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.365712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3bda-219f-4576-9e71-5edad3e0a516 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.367077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3bda-219f-4576-9e71-5edad3e0a516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:43.378726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1026/2050] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:43.378726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccfd3a-9ff2-4c17-a63d-40673f50ef58 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:43.379585 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5fccfd3a-9ff2-4c17-a63d-40673f50ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.392583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccfd3a-9ff2-4c17-a63d-40673f50ef58 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:43.397229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:43.398106 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.398381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.398684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] PATH_INFO: `/v3/users/f3359c75abc24f85bc17f52d3f9531d0` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.399978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3359c75abc24f85bc17f52d3f9531d0)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:43.412446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3bda-219f-4576-9e71-5edad3e0a516 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:43.426926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:43.429837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1025/2051] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:43 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:43.433298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3bda-219f-4576-9e71-5edad3e0a516 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:43.433683 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e2db3bda-219f-4576-9e71-5edad3e0a516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.450211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3bda-219f-4576-9e71-5edad3e0a516 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:43.459720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:43.461600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.462788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.463532 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] PATH_INFO: `/v3/projects/021ad5bdd093462e8b09e2aa9258fe5f` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.465901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021ad5bdd093462e8b09e2aa9258fe5f)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:43.500079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:43.502220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3359c75abc24f85bc17f52d3f9531d0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.524455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3359c75abc24f85bc17f52d3f9531d0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.536182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3359c75abc24f85bc17f52d3f9531d0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.537260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3359c75abc24f85bc17f52d3f9531d0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.548564 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3359c75abc24f85bc17f52d3f9531d0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.568278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1027/2052] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:43 2021] DELETE /identity/v3/users/f3359c75abc24f85bc17f52d3f9531d0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:43.571238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:43.574236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021ad5bdd093462e8b09e2aa9258fe5f', 'request_id': 'req-943d6a39-7484-4430-8fa7-5d940b99bdd4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.575091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.588020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021ad5bdd093462e8b09e2aa9258fe5f', 'request_id': 'req-943d6a39-7484-4430-8fa7-5d940b99bdd4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.599653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021ad5bdd093462e8b09e2aa9258fe5f', 'request_id': 'req-943d6a39-7484-4430-8fa7-5d940b99bdd4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.622929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] The token cache is being invalidate because project 021ad5bdd093462e8b09e2aa9258fe5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:43.624151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.625479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.628518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1026/2053] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:43 2021] DELETE /identity/v3/projects/021ad5bdd093462e8b09e2aa9258fe5f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:43.630038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:43.632330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.691790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da999df-d7f7-4564-ad43-9071c0765281 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:43.699847 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526888-4020-4778-9ad3-7497c8933d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:43.700925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526888-4020-4778-9ad3-7497c8933d6d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.701462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526888-4020-4778-9ad3-7497c8933d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.701979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526888-4020-4778-9ad3-7497c8933d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.703473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8526888-4020-4778-9ad3-7497c8933d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:43.703962 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8526888-4020-4778-9ad3-7497c8933d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:43.749507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d6a39-7484-4430-8fa7-5d940b99bdd4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:43.756729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091194a0-d80d-43d4-bb21-9abc8f9b6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:43.758135 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091194a0-d80d-43d4-bb21-9abc8f9b6fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.758620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091194a0-d80d-43d4-bb21-9abc8f9b6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.759089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091194a0-d80d-43d4-bb21-9abc8f9b6fe4 admin admin] PATH_INFO: `/v3/projects/c2109a7078ee45b1b922e81c997328cb/users/f8c9d652402e4465b4820436357bdc72/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.764260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8526888-4020-4778-9ad3-7497c8933d6d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:43.785602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1028/2054] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:43.785602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a470d5-0bbb-4898-9001-f30f59a85fa1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.785602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a470d5-0bbb-4898-9001-f30f59a85fa1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.785602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a470d5-0bbb-4898-9001-f30f59a85fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.797382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091194a0-d80d-43d4-bb21-9abc8f9b6fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2109a7078ee45b1b922e81c997328cb, user_id=f8c9d652402e4465b4820436357bdc72, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:43.819635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-f3a470d5-0bbb-4898-9001-f30f59a85fa1 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:43.821167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f3a470d5-0bbb-4898-9001-f30f59a85fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.831513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1029/2055] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:43.832694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a470d5-0bbb-4898-9001-f30f59a85fa1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:43.834707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f3a470d5-0bbb-4898-9001-f30f59a85fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.852529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a470d5-0bbb-4898-9001-f30f59a85fa1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:43.852820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091194a0-d80d-43d4-bb21-9abc8f9b6fe4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:43.860721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:43.862025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.862553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.863065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] PATH_INFO: `/v3/users/70860054837741988c62f51903fe15eb` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.864910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70860054837741988c62f51903fe15eb)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:43.874969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1027/2056] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:43 2021] PUT /identity/v3/projects/c2109a7078ee45b1b922e81c997328cb/users/f8c9d652402e4465b4820436357bdc72/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:43.876014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091194a0-d80d-43d4-bb21-9abc8f9b6fe4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:43.877982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-091194a0-d80d-43d4-bb21-9abc8f9b6fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:43.906600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:43.974952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70860054837741988c62f51903fe15eb'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.987830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091194a0-d80d-43d4-bb21-9abc8f9b6fe4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:43.992108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70860054837741988c62f51903fe15eb'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:43.994597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e8c07-f818-492e-a063-814c2d50b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:43.995502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8c07-f818-492e-a063-814c2d50b5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:43.995904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8c07-f818-492e-a063-814c2d50b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:43.996286 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8c07-f818-492e-a063-814c2d50b5b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:43.997113 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e8c07-f818-492e-a063-814c2d50b5b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:44.005192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70860054837741988c62f51903fe15eb'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:44.006503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70860054837741988c62f51903fe15eb'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:44.021397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70860054837741988c62f51903fe15eb'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:44.025410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e8c07-f818-492e-a063-814c2d50b5b2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:44.034333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1030/2057] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:43 2021] DELETE /identity/v3/users/70860054837741988c62f51903fe15eb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:44.037359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:44.043177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:44.070968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1028/2058] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:43 2021] POST /identity/v3/projects => generated 401 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:44.072385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c04f8-5ae6-41a4-86b3-8e2ecb323272 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:44.072688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c04f8-5ae6-41a4-86b3-8e2ecb323272 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:44.072967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c04f8-5ae6-41a4-86b3-8e2ecb323272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:44.098106 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-675c04f8-5ae6-41a4-86b3-8e2ecb323272 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:44.099287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-675c04f8-5ae6-41a4-86b3-8e2ecb323272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:44.179394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1029/2059] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:44.180401 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c04f8-5ae6-41a4-86b3-8e2ecb323272 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:44.182193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-675c04f8-5ae6-41a4-86b3-8e2ecb323272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:44.198547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c04f8-5ae6-41a4-86b3-8e2ecb323272 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:44.203695 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c914e9-2ba2-42da-ad2c-0d23d3062fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:44.204405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c914e9-2ba2-42da-ad2c-0d23d3062fec admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:44.204763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c914e9-2ba2-42da-ad2c-0d23d3062fec admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:44.205113 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c914e9-2ba2-42da-ad2c-0d23d3062fec admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:44.205834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c914e9-2ba2-42da-ad2c-0d23d3062fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:44.234977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c914e9-2ba2-42da-ad2c-0d23d3062fec admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:44.250068 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca5eb1-6e04-48ca-a2e3-20bc786e8f24 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:44.267097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1030/2060] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:44 2021] POST /identity/v3/users => generated 301 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:44.275213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c914e9-2ba2-42da-ad2c-0d23d3062fec admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:44.419939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c914e9-2ba2-42da-ad2c-0d23d3062fec admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:44.424817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04130-e735-4978-943d-ee752586b942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:44.425468 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04130-e735-4978-943d-ee752586b942 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:44.425757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04130-e735-4978-943d-ee752586b942 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:44.426065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04130-e735-4978-943d-ee752586b942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:44.434733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab121b2-a554-4f78-a374-934b770d2a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:44.436583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab121b2-a554-4f78-a374-934b770d2a7f service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:44.437537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab121b2-a554-4f78-a374-934b770d2a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:44.438310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab121b2-a554-4f78-a374-934b770d2a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:44.439026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce04130-e735-4978-943d-ee752586b942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:44.443340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2ab121b2-a554-4f78-a374-934b770d2a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:44.469237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce04130-e735-4978-943d-ee752586b942 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:44.477844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab121b2-a554-4f78-a374-934b770d2a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:44.480778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1031/2061] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:44.481655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04130-e735-4978-943d-ee752586b942 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:44.491542 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04130-e735-4978-943d-ee752586b942 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:44.496888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9164c-d246-4be8-bc30-59a38ed6ff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:44.497503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9164c-d246-4be8-bc30-59a38ed6ff8b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:44.497785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9164c-d246-4be8-bc30-59a38ed6ff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:44.498177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9164c-d246-4be8-bc30-59a38ed6ff8b admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:44.498915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9164c-d246-4be8-bc30-59a38ed6ff8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:44.528082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9164c-d246-4be8-bc30-59a38ed6ff8b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:44.540593 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1032/2062] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:44 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:44.544768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9164c-d246-4be8-bc30-59a38ed6ff8b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:44.556031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9164c-d246-4be8-bc30-59a38ed6ff8b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:44.561815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b463f05-0974-48e2-bd7f-4765bea84033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:44.562873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b463f05-0974-48e2-bd7f-4765bea84033 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:44.563244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b463f05-0974-48e2-bd7f-4765bea84033 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:44.563564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b463f05-0974-48e2-bd7f-4765bea84033 admin admin] PATH_INFO: `/v3/projects/7d103c5e52074bd195520d241e6ff30b/users/9a1db7363de54143bcea2dbad504a0bd/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:44.566534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab121b2-a554-4f78-a374-934b770d2a7f service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:44.595869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1031/2063] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:44.776800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b463f05-0974-48e2-bd7f-4765bea84033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d103c5e52074bd195520d241e6ff30b, user_id=9a1db7363de54143bcea2dbad504a0bd, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:44.888350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b463f05-0974-48e2-bd7f-4765bea84033 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:44.920192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1033/2064] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:44 2021] PUT /identity/v3/projects/7d103c5e52074bd195520d241e6ff30b/users/9a1db7363de54143bcea2dbad504a0bd/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:44.939840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d820315-f7ca-4df4-a9b5-634c8ca820b6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:44.940394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d820315-f7ca-4df4-a9b5-634c8ca820b6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:44.940913 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d820315-f7ca-4df4-a9b5-634c8ca820b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.036019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b463f05-0974-48e2-bd7f-4765bea84033 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:45.038987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8b463f05-0974-48e2-bd7f-4765bea84033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:45.061076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1d820315-f7ca-4df4-a9b5-634c8ca820b6 None None] MFA Rules not processed for user `9a1db7363de54143bcea2dbad504a0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:45.066883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1d820315-f7ca-4df4-a9b5-634c8ca820b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:45.258476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1032/2065] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:44 2021] POST /identity/v3/auth/tokens => generated 3708 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:45.263569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d820315-f7ca-4df4-a9b5-634c8ca820b6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:45.278048 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b463f05-0974-48e2-bd7f-4765bea84033 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:45.285736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d820315-f7ca-4df4-a9b5-634c8ca820b6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:45.289209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:45.291558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.292252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.293090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] PATH_INFO: `/v3/projects/0920ab4b1a194f66a10f71f39b6215a5` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.294554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fedda4-e35e-4494-956f-a530dfe9c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:45.296248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fedda4-e35e-4494-956f-a530dfe9c675 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.296890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fedda4-e35e-4494-956f-a530dfe9c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.297349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fedda4-e35e-4494-956f-a530dfe9c675 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.298264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fedda4-e35e-4494-956f-a530dfe9c675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:45.306504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0920ab4b1a194f66a10f71f39b6215a5)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:45.337299 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fedda4-e35e-4494-956f-a530dfe9c675 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:45.372526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:45.390354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1033/2066] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:45 2021] POST /identity/v3/projects => generated 399 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:45.396312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fedda4-e35e-4494-956f-a530dfe9c675 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:45.547569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fedda4-e35e-4494-956f-a530dfe9c675 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:45.590729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0920ab4b1a194f66a10f71f39b6215a5', 'request_id': 'req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:45.647455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0920ab4b1a194f66a10f71f39b6215a5', 'request_id': 'req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:45.672282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0920ab4b1a194f66a10f71f39b6215a5', 'request_id': 'req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:45.704158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89dc2-7111-4b10-a3ca-bb31f43ec7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:45.705034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89dc2-7111-4b10-a3ca-bb31f43ec7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.705034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89dc2-7111-4b10-a3ca-bb31f43ec7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.705368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89dc2-7111-4b10-a3ca-bb31f43ec7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.705971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89dc2-7111-4b10-a3ca-bb31f43ec7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:45.718818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] The token cache is being invalidate because project 0920ab4b1a194f66a10f71f39b6215a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:45.722963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:45.727647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0a4083c6-0d6c-49ea-86b8-c3e64527fdfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:45.736033 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1034/2067] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:45 2021] DELETE /identity/v3/projects/0920ab4b1a194f66a10f71f39b6215a5 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:45.747199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5554-59af-4546-821e-b5a7ca1f47eb None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.747562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89dc2-7111-4b10-a3ca-bb31f43ec7a9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:45.754298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5554-59af-4546-821e-b5a7ca1f47eb None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.755087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c5554-59af-4546-821e-b5a7ca1f47eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.772046 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1034/2068] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:45 2021] POST /identity/v3/users => generated 306 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:45.777637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89dc2-7111-4b10-a3ca-bb31f43ec7a9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:45.784847 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-64a89dc2-7111-4b10-a3ca-bb31f43ec7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:45.815919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-cd3c5554-59af-4546-821e-b5a7ca1f47eb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:45.818387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89dc2-7111-4b10-a3ca-bb31f43ec7a9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:45.819728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cd3c5554-59af-4546-821e-b5a7ca1f47eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:45.828169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08045def-01d4-42c2-97da-a566f0238b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:45.828954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08045def-01d4-42c2-97da-a566f0238b2a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.829296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08045def-01d4-42c2-97da-a566f0238b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.829703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08045def-01d4-42c2-97da-a566f0238b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.830656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08045def-01d4-42c2-97da-a566f0238b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:45.840394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1035/2069] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:45.852937 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d57ae-027b-4301-b3d1-94147a2f9ad8 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.853639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d57ae-027b-4301-b3d1-94147a2f9ad8 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.854413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d57ae-027b-4301-b3d1-94147a2f9ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.885466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08045def-01d4-42c2-97da-a566f0238b2a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:45.901915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1035/2070] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:45.909574 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08045def-01d4-42c2-97da-a566f0238b2a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:45.911568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-1f7d57ae-027b-4301-b3d1-94147a2f9ad8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:45.914062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1f7d57ae-027b-4301-b3d1-94147a2f9ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:45.923209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08045def-01d4-42c2-97da-a566f0238b2a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:45.929080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1036/2071] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:45.934689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ab0d7-6bb4-431d-8761-a1a8875f4ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:45.935689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d57ae-027b-4301-b3d1-94147a2f9ad8 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:45.936450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ab0d7-6bb4-431d-8761-a1a8875f4ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.937082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ab0d7-6bb4-431d-8761-a1a8875f4ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.937702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ab0d7-6bb4-431d-8761-a1a8875f4ca8 admin admin] PATH_INFO: `/v3/projects/e167727db5dd4d97bc42b47d4c956b5c/users/5c0e86376f084d12ac20b349bafa45f0/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.954060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d57ae-027b-4301-b3d1-94147a2f9ad8 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:45.964309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:45.965345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:45.965880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:45.966504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:45.967824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:45.968497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:46.013180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:46.024496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ab0d7-6bb4-431d-8761-a1a8875f4ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e167727db5dd4d97bc42b47d4c956b5c, user_id=5c0e86376f084d12ac20b349bafa45f0, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:46.040920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1037/2072] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:39:46.042215 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:46.044659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:46.062917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95019b-8112-470d-b56a-5fe5a0098d34 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:46.069342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:46.070607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:46.071292 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:46.071767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] PATH_INFO: `/v3/projects/592f3e02ebed4dc2b8ec77685579e681` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:46.073718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] RBAC: Authorizing `identity:delete_project(project_id=592f3e02ebed4dc2b8ec77685579e681)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:46.099368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ab0d7-6bb4-431d-8761-a1a8875f4ca8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:46.105350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:46.132045 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1036/2073] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:45 2021] PUT /identity/v3/projects/e167727db5dd4d97bc42b47d4c956b5c/users/5c0e86376f084d12ac20b349bafa45f0/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:46.134770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ab0d7-6bb4-431d-8761-a1a8875f4ca8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:46.210747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592f3e02ebed4dc2b8ec77685579e681', 'request_id': 'req-e09b784b-aa03-4172-ba05-3a05758e550b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:46.228257 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592f3e02ebed4dc2b8ec77685579e681', 'request_id': 'req-e09b784b-aa03-4172-ba05-3a05758e550b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:46.243945 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592f3e02ebed4dc2b8ec77685579e681', 'request_id': 'req-e09b784b-aa03-4172-ba05-3a05758e550b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:46.262862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] The token cache is being invalidate because project 592f3e02ebed4dc2b8ec77685579e681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:46.263732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:46.265504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:46.276762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1038/2074] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:46 2021] DELETE /identity/v3/projects/592f3e02ebed4dc2b8ec77685579e681 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:46.276762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:46.279032 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:46.315745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ab0d7-6bb4-431d-8761-a1a8875f4ca8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:46.413507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b784b-aa03-4172-ba05-3a05758e550b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:46.420783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e5044-5897-484d-904b-f0f4c5cb5db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:46.421979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e5044-5897-484d-904b-f0f4c5cb5db9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:46.422434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e5044-5897-484d-904b-f0f4c5cb5db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:46.422885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e5044-5897-484d-904b-f0f4c5cb5db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:46.424025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e5044-5897-484d-904b-f0f4c5cb5db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:46.475014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e5044-5897-484d-904b-f0f4c5cb5db9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:46.484225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9a38-5378-468c-900e-f16bd7ff83a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:46.485171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9a38-5378-468c-900e-f16bd7ff83a2 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:46.486680 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9a38-5378-468c-900e-f16bd7ff83a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:46.487595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9a38-5378-468c-900e-f16bd7ff83a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:46.490608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c9a38-5378-468c-900e-f16bd7ff83a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:46.498798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1039/2075] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:46 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:46.500999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3827e9f-c5b1-4882-b68b-03109203b2a0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:46.501520 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3827e9f-c5b1-4882-b68b-03109203b2a0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:46.501983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3827e9f-c5b1-4882-b68b-03109203b2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:46.554484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c3827e9f-c5b1-4882-b68b-03109203b2a0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:46.556039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c3827e9f-c5b1-4882-b68b-03109203b2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:46.562499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c9a38-5378-468c-900e-f16bd7ff83a2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:46.576499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1040/2076] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:46.578594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3827e9f-c5b1-4882-b68b-03109203b2a0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:46.592557 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3827e9f-c5b1-4882-b68b-03109203b2a0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:46.601343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414c01a-61bc-4b0c-a8ea-366d20607267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:46.602924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414c01a-61bc-4b0c-a8ea-366d20607267 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:46.603133 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414c01a-61bc-4b0c-a8ea-366d20607267 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:46.603505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414c01a-61bc-4b0c-a8ea-366d20607267 admin admin] PATH_INFO: `/v3/projects/e167727db5dd4d97bc42b47d4c956b5c/users/5c0e86376f084d12ac20b349bafa45f0/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:46.607836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414c01a-61bc-4b0c-a8ea-366d20607267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e167727db5dd4d97bc42b47d4c956b5c, user_id=5c0e86376f084d12ac20b349bafa45f0, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:46.630756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1037/2077] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:46 2021] POST /identity/v3/projects => generated 381 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:46.633657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d30c7f-0f81-459e-ad72-8a88a68b3f62 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:46.634674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d30c7f-0f81-459e-ad72-8a88a68b3f62 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:46.635399 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d30c7f-0f81-459e-ad72-8a88a68b3f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:46.673487 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414c01a-61bc-4b0c-a8ea-366d20607267 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:46.687065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-97d30c7f-0f81-459e-ad72-8a88a68b3f62 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:46.689750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-97d30c7f-0f81-459e-ad72-8a88a68b3f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:46.704999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1041/2078] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:46 2021] PUT /identity/v3/projects/e167727db5dd4d97bc42b47d4c956b5c/users/5c0e86376f084d12ac20b349bafa45f0/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:46.707375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414c01a-61bc-4b0c-a8ea-366d20607267 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:46.712023 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4414c01a-61bc-4b0c-a8ea-366d20607267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:46.833801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414c01a-61bc-4b0c-a8ea-366d20607267 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:46.839784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7629590-6868-447d-8203-b67b086bce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:46.841005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7629590-6868-447d-8203-b67b086bce98 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:46.841507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7629590-6868-447d-8203-b67b086bce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:46.842138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7629590-6868-447d-8203-b67b086bce98 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:46.843690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7629590-6868-447d-8203-b67b086bce98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:46.878631 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7629590-6868-447d-8203-b67b086bce98 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:46.911731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1042/2079] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:46 2021] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:46.912719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7629590-6868-447d-8203-b67b086bce98 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:46.940337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7629590-6868-447d-8203-b67b086bce98 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:46.954964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfd6b6-b5cc-406c-ba95-6c05a6b78a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:46.955704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd6b6-b5cc-406c-ba95-6c05a6b78a92 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:46.956056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd6b6-b5cc-406c-ba95-6c05a6b78a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:46.956416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd6b6-b5cc-406c-ba95-6c05a6b78a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:46.957275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfd6b6-b5cc-406c-ba95-6c05a6b78a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:47.018357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1038/2080] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:47.018357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d30c7f-0f81-459e-ad72-8a88a68b3f62 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:47.040764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfd6b6-b5cc-406c-ba95-6c05a6b78a92 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:47.048122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d30c7f-0f81-459e-ad72-8a88a68b3f62 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:47.071972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65c95b-5764-4e0f-98bc-60703630edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:47.075279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65c95b-5764-4e0f-98bc-60703630edb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:47.075902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65c95b-5764-4e0f-98bc-60703630edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:47.076462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65c95b-5764-4e0f-98bc-60703630edb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:47.081806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65c95b-5764-4e0f-98bc-60703630edb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:47.086664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1043/2081] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:46 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:47.088658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfd6b6-b5cc-406c-ba95-6c05a6b78a92 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:47.131514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfd6b6-b5cc-406c-ba95-6c05a6b78a92 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:47.139119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b3c74-eed1-456b-892b-b8e3927e1690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:47.140012 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3c74-eed1-456b-892b-b8e3927e1690 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:47.140353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3c74-eed1-456b-892b-b8e3927e1690 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:47.140570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3c74-eed1-456b-892b-b8e3927e1690 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:47.141331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3c74-eed1-456b-892b-b8e3927e1690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:47.141646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3c74-eed1-456b-892b-b8e3927e1690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:47.168355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65c95b-5764-4e0f-98bc-60703630edb5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:47.194499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3c74-eed1-456b-892b-b8e3927e1690 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:47.209186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1039/2082] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:47 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:47.209186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65c95b-5764-4e0f-98bc-60703630edb5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:47.218196 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65c95b-5764-4e0f-98bc-60703630edb5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:47.224632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1f76e-87c9-4a0d-972a-085a974637b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:47.225545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1f76e-87c9-4a0d-972a-085a974637b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:47.225827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1f76e-87c9-4a0d-972a-085a974637b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:47.226159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1f76e-87c9-4a0d-972a-085a974637b9 admin admin] PATH_INFO: `/v3/projects/e167727db5dd4d97bc42b47d4c956b5c/users/5c0e86376f084d12ac20b349bafa45f0/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:47.229002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1f76e-87c9-4a0d-972a-085a974637b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e167727db5dd4d97bc42b47d4c956b5c, user_id=5c0e86376f084d12ac20b349bafa45f0, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:47.240009 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1044/2083] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:47.242237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b3c74-eed1-456b-892b-b8e3927e1690 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:47.272381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b3c74-eed1-456b-892b-b8e3927e1690 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:47.275420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1f76e-87c9-4a0d-972a-085a974637b9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:47.282231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a1bc0-f99a-4715-aba5-ad07b9844eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:47.285140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a1bc0-f99a-4715-aba5-ad07b9844eba admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:47.286647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a1bc0-f99a-4715-aba5-ad07b9844eba admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:47.287428 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a1bc0-f99a-4715-aba5-ad07b9844eba admin admin] PATH_INFO: `/v3/projects/206044bd785040fdb9c926cd3df5e271/users/d5262ef8562a47d2add055ccfa9ccacd/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:47.317807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1040/2084] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:47 2021] PUT /identity/v3/projects/e167727db5dd4d97bc42b47d4c956b5c/users/5c0e86376f084d12ac20b349bafa45f0/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:47.320052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1f76e-87c9-4a0d-972a-085a974637b9 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:47.393590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a1bc0-f99a-4715-aba5-ad07b9844eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=206044bd785040fdb9c926cd3df5e271, user_id=d5262ef8562a47d2add055ccfa9ccacd, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:47.526692 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1f76e-87c9-4a0d-972a-085a974637b9 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:47.540895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44890-23ff-4820-a8fe-967c200963ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:47.541714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44890-23ff-4820-a8fe-967c200963ef admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:47.542944 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44890-23ff-4820-a8fe-967c200963ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:47.543340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44890-23ff-4820-a8fe-967c200963ef admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:47.545255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44890-23ff-4820-a8fe-967c200963ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:47.563896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a1bc0-f99a-4715-aba5-ad07b9844eba admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:47.597833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1045/2085] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:47 2021] PUT /identity/v3/projects/206044bd785040fdb9c926cd3df5e271/users/d5262ef8562a47d2add055ccfa9ccacd/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:47.615383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8af416-8f77-4e5b-89e3-67e115f56af2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:47.615383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8af416-8f77-4e5b-89e3-67e115f56af2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:47.615383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8af416-8f77-4e5b-89e3-67e115f56af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:47.618640 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44890-23ff-4820-a8fe-967c200963ef admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:47.679454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4a8af416-8f77-4e5b-89e3-67e115f56af2 None None] MFA Rules not processed for user `5c0e86376f084d12ac20b349bafa45f0`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:47.690048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1041/2086] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:47 2021] POST /identity/v3/projects => generated 371 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:47.690311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4a8af416-8f77-4e5b-89e3-67e115f56af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:47.690399 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a267b-0a10-428c-9bb0-ce9c1c22ad7d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:47.691828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a267b-0a10-428c-9bb0-ce9c1c22ad7d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:47.693017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a267b-0a10-428c-9bb0-ce9c1c22ad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:47.810339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-9b9a267b-0a10-428c-9bb0-ce9c1c22ad7d None None] MFA Rules not processed for user `d5262ef8562a47d2add055ccfa9ccacd`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:47.812616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9b9a267b-0a10-428c-9bb0-ce9c1c22ad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:47.879102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1046/2087] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:47 2021] POST /identity/v3/auth/tokens => generated 3773 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:47.880535 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8af416-8f77-4e5b-89e3-67e115f56af2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:48.011194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8af416-8f77-4e5b-89e3-67e115f56af2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:48.016171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1042/2088] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:47 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:48.017452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a267b-0a10-428c-9bb0-ce9c1c22ad7d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:48.019152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9b9a267b-0a10-428c-9bb0-ce9c1c22ad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:48.029408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ee850-da94-461b-bfb1-373c306dfd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:48.030211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ee850-da94-461b-bfb1-373c306dfd53 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:48.030547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ee850-da94-461b-bfb1-373c306dfd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:48.030854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ee850-da94-461b-bfb1-373c306dfd53 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:48.031637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ee850-da94-461b-bfb1-373c306dfd53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:48.103877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ee850-da94-461b-bfb1-373c306dfd53 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:48.172408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1047/2089] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:47 2021] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:48.175489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ee850-da94-461b-bfb1-373c306dfd53 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:48.205592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ee850-da94-461b-bfb1-373c306dfd53 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:48.219637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803fcc-3e78-4b37-9ca4-773fb94f1825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:48.221488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803fcc-3e78-4b37-9ca4-773fb94f1825 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:48.222265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803fcc-3e78-4b37-9ca4-773fb94f1825 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:48.224169 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803fcc-3e78-4b37-9ca4-773fb94f1825 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:48.225451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8803fcc-3e78-4b37-9ca4-773fb94f1825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:48.270913 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a267b-0a10-428c-9bb0-ce9c1c22ad7d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:48.274969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6cc70-b6bb-46e3-a448-1ee5ccf65898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:48.282443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6cc70-b6bb-46e3-a448-1ee5ccf65898 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:48.283029 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6cc70-b6bb-46e3-a448-1ee5ccf65898 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:48.283606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6cc70-b6bb-46e3-a448-1ee5ccf65898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:48.285842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8803fcc-3e78-4b37-9ca4-773fb94f1825 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:48.312067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6cc70-b6bb-46e3-a448-1ee5ccf65898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:48.355518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1048/2090] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:48 2021] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:48.356296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803fcc-3e78-4b37-9ca4-773fb94f1825 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:48.368370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6cc70-b6bb-46e3-a448-1ee5ccf65898 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:48.400486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1043/2091] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:48 2021] GET /identity/v3/auth/tokens => generated 3773 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:48.402093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6cc70-b6bb-46e3-a448-1ee5ccf65898 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:48.435979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6cc70-b6bb-46e3-a448-1ee5ccf65898 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:48.479264 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803fcc-3e78-4b37-9ca4-773fb94f1825 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:48.487540 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db1b40-94fa-41bd-9496-531e9dae6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:48.488749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db1b40-94fa-41bd-9496-531e9dae6d81 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:48.489385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db1b40-94fa-41bd-9496-531e9dae6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:48.490226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db1b40-94fa-41bd-9496-531e9dae6d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:48.491455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db1b40-94fa-41bd-9496-531e9dae6d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:48.527650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db1b40-94fa-41bd-9496-531e9dae6d81 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:48.560079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1049/2092] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:48.562917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db1b40-94fa-41bd-9496-531e9dae6d81 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:48.607516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db1b40-94fa-41bd-9496-531e9dae6d81 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:48.627591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a36a63-84bc-4b03-8472-4b2c3cfa88af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:48.628955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a36a63-84bc-4b03-8472-4b2c3cfa88af admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:48.629568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a36a63-84bc-4b03-8472-4b2c3cfa88af admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:48.630137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a36a63-84bc-4b03-8472-4b2c3cfa88af admin admin] PATH_INFO: `/v3/projects/27465ba1e8a64aeb8e34d281dadbebd7/users/f439bb613e6a4e38a6c0669fe7394d8f/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:48.664167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a36a63-84bc-4b03-8472-4b2c3cfa88af admin admin] RBAC: Authorizing `identity:create_grant(project_id=27465ba1e8a64aeb8e34d281dadbebd7, user_id=f439bb613e6a4e38a6c0669fe7394d8f, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:48.706312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a36a63-84bc-4b03-8472-4b2c3cfa88af admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:48.730507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1050/2093] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:48 2021] PUT /identity/v3/projects/27465ba1e8a64aeb8e34d281dadbebd7/users/f439bb613e6a4e38a6c0669fe7394d8f/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:48.745918 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02da0b-24a1-4176-b8d7-d00dfc6ae4fd None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:48.747253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02da0b-24a1-4176-b8d7-d00dfc6ae4fd None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:48.747862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02da0b-24a1-4176-b8d7-d00dfc6ae4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:48.791734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de71e3-a891-48b9-ba38-14e1989dae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:48.792992 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de71e3-a891-48b9-ba38-14e1989dae3b admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:48.793897 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de71e3-a891-48b9-ba38-14e1989dae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:48.794980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de71e3-a891-48b9-ba38-14e1989dae3b admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:48.796785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de71e3-a891-48b9-ba38-14e1989dae3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:48.824689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4d02da0b-24a1-4176-b8d7-d00dfc6ae4fd None None] MFA Rules not processed for user `f439bb613e6a4e38a6c0669fe7394d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:48.827625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4d02da0b-24a1-4176-b8d7-d00dfc6ae4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:48.834111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de71e3-a891-48b9-ba38-14e1989dae3b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:48.863364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1044/2094] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:48 2021] POST /identity/v3/users => generated 298 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:48.864458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de71e3-a891-48b9-ba38-14e1989dae3b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:48.969952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de71e3-a891-48b9-ba38-14e1989dae3b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.024590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1051/2095] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:48 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:49.026178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02da0b-24a1-4176-b8d7-d00dfc6ae4fd None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.113107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01969477-57b4-416e-aa03-b105688469b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.114449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01969477-57b4-416e-aa03-b105688469b4 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.114960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01969477-57b4-416e-aa03-b105688469b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.115277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01969477-57b4-416e-aa03-b105688469b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.118282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-01969477-57b4-416e-aa03-b105688469b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:49.166641 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02da0b-24a1-4176-b8d7-d00dfc6ae4fd None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.181637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0b6a6-6bb8-421c-a992-c1e5d34989fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.182399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0b6a6-6bb8-421c-a992-c1e5d34989fe admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.182804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0b6a6-6bb8-421c-a992-c1e5d34989fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.183302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0b6a6-6bb8-421c-a992-c1e5d34989fe admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.184115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0b6a6-6bb8-421c-a992-c1e5d34989fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:49.224559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0b6a6-6bb8-421c-a992-c1e5d34989fe admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.243140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1052/2096] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:49.245105 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5874d-e5e2-41d3-a0ce-e87ce35f1950 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.245603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5874d-e5e2-41d3-a0ce-e87ce35f1950 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.246027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5874d-e5e2-41d3-a0ce-e87ce35f1950 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.249214 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1053/2097] 10.222.0.67 () {54 vars in 956 bytes} [Thu Dec 16 14:39:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:39:49.250320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5874d-e5e2-41d3-a0ce-e87ce35f1950 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.267834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5874d-e5e2-41d3-a0ce-e87ce35f1950 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.273632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2a4e-8d89-41b6-aff8-4f396795fd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.274753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2a4e-8d89-41b6-aff8-4f396795fd8d admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.275272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2a4e-8d89-41b6-aff8-4f396795fd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.275836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2a4e-8d89-41b6-aff8-4f396795fd8d admin admin] PATH_INFO: `/v3/projects/9fdf4de0f0bf4a0489acd12bc56bf9d9/users/5e95e214c0d4416ea1e0f22ab0d60ac1/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.294759 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01969477-57b4-416e-aa03-b105688469b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:49.313106 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e2a4e-8d89-41b6-aff8-4f396795fd8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdf4de0f0bf4a0489acd12bc56bf9d9, user_id=5e95e214c0d4416ea1e0f22ab0d60ac1, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:49.321295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01969477-57b4-416e-aa03-b105688469b4 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.334172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1045/2098] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:48 2021] GET /identity/v3/auth/tokens => generated 3708 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:49.336069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d06d27-60b6-4e2f-92a5-0d6877222b6c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.336354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d06d27-60b6-4e2f-92a5-0d6877222b6c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.336634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d06d27-60b6-4e2f-92a5-0d6877222b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.353868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e2a4e-8d89-41b6-aff8-4f396795fd8d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.366923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d2d06d27-60b6-4e2f-92a5-0d6877222b6c None None] MFA Rules not processed for user `0b797c99041b4e9c9cde7d0064013fda`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:49.369401 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d2d06d27-60b6-4e2f-92a5-0d6877222b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:49.375457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1054/2099] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:49 2021] PUT /identity/v3/projects/9fdf4de0f0bf4a0489acd12bc56bf9d9/users/5e95e214c0d4416ea1e0f22ab0d60ac1/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:49.380903 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2a4e-8d89-41b6-aff8-4f396795fd8d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.489578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1046/2100] 10.222.0.67 () {58 vars in 1053 bytes} [Thu Dec 16 14:39:49 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:49.499440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d06d27-60b6-4e2f-92a5-0d6877222b6c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.508003 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2a4e-8d89-41b6-aff8-4f396795fd8d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.515240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee0698-b33c-4934-9631-4304f8cd3d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.516409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0698-b33c-4934-9631-4304f8cd3d6a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.516837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0698-b33c-4934-9631-4304f8cd3d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.517244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0698-b33c-4934-9631-4304f8cd3d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.519568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee0698-b33c-4934-9631-4304f8cd3d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:49.527517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d06d27-60b6-4e2f-92a5-0d6877222b6c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.535179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90854790-f7e6-4841-90f5-e3b674206fdd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b797c99041b4e9c9cde7d0064013fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.536539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854790-f7e6-4841-90f5-e3b674206fdd service glance] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.537215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854790-f7e6-4841-90f5-e3b674206fdd service glance] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.537924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854790-f7e6-4841-90f5-e3b674206fdd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.561370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee0698-b33c-4934-9631-4304f8cd3d6a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.578242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1055/2101] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:49.582160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee0698-b33c-4934-9631-4304f8cd3d6a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.595925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee0698-b33c-4934-9631-4304f8cd3d6a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.602415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e225-c550-4055-a3a8-1f90e5ccc5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.603896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e225-c550-4055-a3a8-1f90e5ccc5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.603896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e225-c550-4055-a3a8-1f90e5ccc5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.604200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e225-c550-4055-a3a8-1f90e5ccc5f9 admin admin] PATH_INFO: `/v3/projects/9fdf4de0f0bf4a0489acd12bc56bf9d9/users/5e95e214c0d4416ea1e0f22ab0d60ac1/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.606612 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7e225-c550-4055-a3a8-1f90e5ccc5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdf4de0f0bf4a0489acd12bc56bf9d9, user_id=5e95e214c0d4416ea1e0f22ab0d60ac1, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:49.637371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7e225-c550-4055-a3a8-1f90e5ccc5f9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.670972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1056/2102] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:49 2021] PUT /identity/v3/projects/9fdf4de0f0bf4a0489acd12bc56bf9d9/users/5e95e214c0d4416ea1e0f22ab0d60ac1/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:49.676775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e225-c550-4055-a3a8-1f90e5ccc5f9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.690844 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90854790-f7e6-4841-90f5-e3b674206fdd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:49.747666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90854790-f7e6-4841-90f5-e3b674206fdd service glance] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.772242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1047/2103] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:49 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:49.806733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e225-c550-4055-a3a8-1f90e5ccc5f9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.814659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4b4df-8b54-4355-be9a-ed8bec0472f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.815706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4b4df-8b54-4355-be9a-ed8bec0472f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.816206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4b4df-8b54-4355-be9a-ed8bec0472f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.816645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4b4df-8b54-4355-be9a-ed8bec0472f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.817630 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4b4df-8b54-4355-be9a-ed8bec0472f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:49.854492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4b4df-8b54-4355-be9a-ed8bec0472f8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:49.871863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1057/2104] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:39:49.879031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90854790-f7e6-4841-90f5-e3b674206fdd service glance] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:49.915327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90854790-f7e6-4841-90f5-e3b674206fdd service glance] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:49.948921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5db34d-2845-473c-8661-2e39e55cc2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:49.951611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db34d-2845-473c-8661-2e39e55cc2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:49.953206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db34d-2845-473c-8661-2e39e55cc2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:49.954092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db34d-2845-473c-8661-2e39e55cc2ba admin admin] PATH_INFO: `/v3/projects/9fdf4de0f0bf4a0489acd12bc56bf9d9/users/5e95e214c0d4416ea1e0f22ab0d60ac1/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:49.958636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5db34d-2845-473c-8661-2e39e55cc2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdf4de0f0bf4a0489acd12bc56bf9d9, user_id=5e95e214c0d4416ea1e0f22ab0d60ac1, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:50.062411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5db34d-2845-473c-8661-2e39e55cc2ba admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:50.092171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1048/2105] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:39:49 2021] PUT /identity/v3/projects/9fdf4de0f0bf4a0489acd12bc56bf9d9/users/5e95e214c0d4416ea1e0f22ab0d60ac1/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:50.109850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30076c-1259-42c9-afe9-78ee739f16a9 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:50.110431 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30076c-1259-42c9-afe9-78ee739f16a9 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:50.110822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30076c-1259-42c9-afe9-78ee739f16a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:50.250406 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9d30076c-1259-42c9-afe9-78ee739f16a9 None None] MFA Rules not processed for user `5e95e214c0d4416ea1e0f22ab0d60ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:50.258883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9d30076c-1259-42c9-afe9-78ee739f16a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:50.483029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1058/2106] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:50 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:50.552986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5db34d-2845-473c-8661-2e39e55cc2ba admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:50.683441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5db34d-2845-473c-8661-2e39e55cc2ba admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:50.691546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d155c6-bcab-4733-9624-0cc16f7a332a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:50.692176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d155c6-bcab-4733-9624-0cc16f7a332a service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:50.692475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d155c6-bcab-4733-9624-0cc16f7a332a service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:50.692768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d155c6-bcab-4733-9624-0cc16f7a332a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:50.717533 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d155c6-bcab-4733-9624-0cc16f7a332a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:50.749826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d155c6-bcab-4733-9624-0cc16f7a332a service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:50.778528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1049/2107] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:50 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:51.303675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30076c-1259-42c9-afe9-78ee739f16a9 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:51.325735 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30076c-1259-42c9-afe9-78ee739f16a9 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:51.330588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255af956-f681-4b74-9174-ac97a29be3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:51.332452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af956-f681-4b74-9174-ac97a29be3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:51.332452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af956-f681-4b74-9174-ac97a29be3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:51.332452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af956-f681-4b74-9174-ac97a29be3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:51.548049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255af956-f681-4b74-9174-ac97a29be3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:51.616639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255af956-f681-4b74-9174-ac97a29be3a6 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:51.637328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1059/2108] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:51 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:55.421915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d155c6-bcab-4733-9624-0cc16f7a332a service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:55.426135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-69d155c6-bcab-4733-9624-0cc16f7a332a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:55.658308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d155c6-bcab-4733-9624-0cc16f7a332a service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:55.666110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:55.667384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:55.667972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:55.668397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] PATH_INFO: `/v3/users/b144ded7fb4a4cd59207c8f83e00d5cd` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:55.671500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b144ded7fb4a4cd59207c8f83e00d5cd)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:55.713530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:55.804456 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b144ded7fb4a4cd59207c8f83e00d5cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:55.828433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b144ded7fb4a4cd59207c8f83e00d5cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:55.853591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b144ded7fb4a4cd59207c8f83e00d5cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:55.855493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b144ded7fb4a4cd59207c8f83e00d5cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:55.869351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b144ded7fb4a4cd59207c8f83e00d5cd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:55.879288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1050/2109] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:55 2021] DELETE /identity/v3/users/b144ded7fb4a4cd59207c8f83e00d5cd => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:56.287461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255af956-f681-4b74-9174-ac97a29be3a6 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:56.312127 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255af956-f681-4b74-9174-ac97a29be3a6 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:56.463031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:56.465042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:56.465042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:56.475130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] PATH_INFO: `/v3/users/d5262ef8562a47d2add055ccfa9ccacd` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:56.476121 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5262ef8562a47d2add055ccfa9ccacd)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:56.476252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:56.478961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:56.504647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b575b-ce27-46e8-b09b-86652347fc63 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:56.509694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:56.522485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:56.523518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:56.523899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:56.524424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] PATH_INFO: `/v3/projects/7a0291385c194e659fd8cd83c7b3d89e` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:56.526089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0291385c194e659fd8cd83c7b3d89e)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:56.557121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:56.599497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5262ef8562a47d2add055ccfa9ccacd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.619104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5262ef8562a47d2add055ccfa9ccacd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.620615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5262ef8562a47d2add055ccfa9ccacd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.640804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5262ef8562a47d2add055ccfa9ccacd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.672572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-55666ea5-bbdb-42a1-b329-350a85d71492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5262ef8562a47d2add055ccfa9ccacd'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.690912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1060/2110] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:56 2021] DELETE /identity/v3/users/d5262ef8562a47d2add055ccfa9ccacd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:56.699427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa5243-9754-4e21-8cf1-5731c30cf032 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:56.700275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa5243-9754-4e21-8cf1-5731c30cf032 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:56.701355 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa5243-9754-4e21-8cf1-5731c30cf032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:56.746549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0291385c194e659fd8cd83c7b3d89e', 'request_id': 'req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.753731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c9aa5243-9754-4e21-8cf1-5731c30cf032 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:56.756447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c9aa5243-9754-4e21-8cf1-5731c30cf032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:56.776295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0291385c194e659fd8cd83c7b3d89e', 'request_id': 'req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.792733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0291385c194e659fd8cd83c7b3d89e', 'request_id': 'req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.827849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] The token cache is being invalidate because project 7a0291385c194e659fd8cd83c7b3d89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:56.828248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.830231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:56.838572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1051/2111] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:56 2021] DELETE /identity/v3/projects/7a0291385c194e659fd8cd83c7b3d89e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:39:56.839906 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:56.842030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:56.924858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1061/2112] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:56.947965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa5243-9754-4e21-8cf1-5731c30cf032 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:56.951823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c9aa5243-9754-4e21-8cf1-5731c30cf032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:57.086597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4516e2a-f7dd-4322-ab09-6128ecbaf0e5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:57.092997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:57.094105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:57.094465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:57.094875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] PATH_INFO: `/v3/users/42b7b7527143431c95ade6ff01d1d1e8` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:57.097210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b7b7527143431c95ade6ff01d1d1e8)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:57.129714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:57.133295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa5243-9754-4e21-8cf1-5731c30cf032 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:57.143115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dec165-2131-4e39-859d-ad2b2ece6929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:57.144567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec165-2131-4e39-859d-ad2b2ece6929 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:57.144945 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec165-2131-4e39-859d-ad2b2ece6929 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:57.145297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec165-2131-4e39-859d-ad2b2ece6929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:57.171996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dec165-2131-4e39-859d-ad2b2ece6929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:57.239102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dec165-2131-4e39-859d-ad2b2ece6929 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:57.256901 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b7b7527143431c95ade6ff01d1d1e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.259937 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1062/2113] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:57.261441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198324d0-84a9-48e8-9748-74df05699639 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:57.261732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198324d0-84a9-48e8-9748-74df05699639 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:57.262111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198324d0-84a9-48e8-9748-74df05699639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:57.315208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b7b7527143431c95ade6ff01d1d1e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.322060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-198324d0-84a9-48e8-9748-74df05699639 None None] MFA Rules not processed for user `f8c9d652402e4465b4820436357bdc72`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:57.323459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-198324d0-84a9-48e8-9748-74df05699639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:57.329799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b7b7527143431c95ade6ff01d1d1e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.330951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b7b7527143431c95ade6ff01d1d1e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.345949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b7b7527143431c95ade6ff01d1d1e8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.357513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1052/2114] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:56 2021] DELETE /identity/v3/users/42b7b7527143431c95ade6ff01d1d1e8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:57.359224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:57.362991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:57.488015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1063/2115] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:57 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:57.500479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d032b53-b422-4582-aefd-2be7ff19084b None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:57.502115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d032b53-b422-4582-aefd-2be7ff19084b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:57.502842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d032b53-b422-4582-aefd-2be7ff19084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:57.541241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec0dc8-8970-4d6c-9235-1cae8524eb53 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:57.566853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:57.568972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:57.569579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:57.570338 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] PATH_INFO: `/v3/users/9a1db7363de54143bcea2dbad504a0bd` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:57.572744 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1db7363de54143bcea2dbad504a0bd)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:57.573780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3d032b53-b422-4582-aefd-2be7ff19084b None None] MFA Rules not processed for user `f8c9d652402e4465b4820436357bdc72`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:57.575086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3d032b53-b422-4582-aefd-2be7ff19084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:57.615892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:57.760251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1064/2116] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:57 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:57.781370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d032b53-b422-4582-aefd-2be7ff19084b None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:57.783017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3d032b53-b422-4582-aefd-2be7ff19084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:57.789813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1db7363de54143bcea2dbad504a0bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.816126 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1db7363de54143bcea2dbad504a0bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.849005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1db7363de54143bcea2dbad504a0bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.866513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1db7363de54143bcea2dbad504a0bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.882785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8a16839b-2787-42ba-8bc6-033b4cdce167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1db7363de54143bcea2dbad504a0bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:57.910223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1053/2117] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:57 2021] DELETE /identity/v3/users/9a1db7363de54143bcea2dbad504a0bd => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:57.915619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48942b-3045-4778-ae80-9aaab6383225 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:57.916070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48942b-3045-4778-ae80-9aaab6383225 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:57.916447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48942b-3045-4778-ae80-9aaab6383225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:57.961700 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5a48942b-3045-4778-ae80-9aaab6383225 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:57.964055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5a48942b-3045-4778-ae80-9aaab6383225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.011285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d032b53-b422-4582-aefd-2be7ff19084b None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:58.103735 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1054/2118] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:39:58.104869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48942b-3045-4778-ae80-9aaab6383225 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:58.114695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5a48942b-3045-4778-ae80-9aaab6383225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.134320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48942b-3045-4778-ae80-9aaab6383225 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:58.142495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:58.143635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.144528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.145186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] PATH_INFO: `/v3/projects/aa844bed3d2e4085ac814cc6568d7ec7` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:58.146789 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa844bed3d2e4085ac814cc6568d7ec7)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:58.182281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:58.183234 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.183702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.184170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:58.187239 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.211389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:58.297167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa844bed3d2e4085ac814cc6568d7ec7', 'request_id': 'req-8e4c3870-b3fc-43b1-b772-a70febcba13b'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.305264 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:58.315471 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa844bed3d2e4085ac814cc6568d7ec7', 'request_id': 'req-8e4c3870-b3fc-43b1-b772-a70febcba13b'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.326547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa844bed3d2e4085ac814cc6568d7ec7', 'request_id': 'req-8e4c3870-b3fc-43b1-b772-a70febcba13b'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.336660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:58.341540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] The token cache is being invalidate because project aa844bed3d2e4085ac814cc6568d7ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:58.342350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.344044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.350838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1055/2119] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:58 2021] DELETE /identity/v3/projects/aa844bed3d2e4085ac814cc6568d7ec7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:58.352090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:58.353053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1065/2120] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:57 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:39:58.354158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.354741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:58.357910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.390890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d4d7b-a78b-4126-9d4d-82c509244a8b service nova] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:58.484049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c3870-b3fc-43b1-b772-a70febcba13b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:58.493052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56b55-d830-4729-a04a-485b9d39d3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:58.494176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56b55-d830-4729-a04a-485b9d39d3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.494538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56b55-d830-4729-a04a-485b9d39d3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.495067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56b55-d830-4729-a04a-485b9d39d3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:58.497905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-61a56b55-d830-4729-a04a-485b9d39d3d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.550403 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:58.552074 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.552750 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.553417 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] PATH_INFO: `/v3/projects/206044bd785040fdb9c926cd3df5e271` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:58.556500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=206044bd785040fdb9c926cd3df5e271)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:58.613591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56b55-d830-4729-a04a-485b9d39d3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:58.622715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:58.648934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56b55-d830-4729-a04a-485b9d39d3d3 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:58.672971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1056/2121] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:39:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:39:58.675615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ec2b9-c0fa-4557-b4ca-393878214acd None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.676092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ec2b9-c0fa-4557-b4ca-393878214acd None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.676573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ec2b9-c0fa-4557-b4ca-393878214acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:58.721091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b96ec2b9-c0fa-4557-b4ca-393878214acd None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:58.722385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b96ec2b9-c0fa-4557-b4ca-393878214acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.742387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206044bd785040fdb9c926cd3df5e271', 'request_id': 'req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.773325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206044bd785040fdb9c926cd3df5e271', 'request_id': 'req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.792047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206044bd785040fdb9c926cd3df5e271', 'request_id': 'req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.830322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] The token cache is being invalidate because project 206044bd785040fdb9c926cd3df5e271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:39:58.831075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.832607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:58.835979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1066/2122] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:39:58 2021] DELETE /identity/v3/projects/206044bd785040fdb9c926cd3df5e271 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:58.844711 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:58.847439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:58.946856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1057/2123] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:58.961647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8355-4020-4b18-878d-3d524beff55a None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:58.981347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8355-4020-4b18-878d-3d524beff55a None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:58.983587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8355-4020-4b18-878d-3d524beff55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:59.035022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6a8f8355-4020-4b18-878d-3d524beff55a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:39:59.037231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6a8f8355-4020-4b18-878d-3d524beff55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:59.040672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea2d5-c013-42e1-8c2f-a86407fc7e50 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:59.047091 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:59.048887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:59.049530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:59.050044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] PATH_INFO: `/v3/users/5e95e214c0d4416ea1e0f22ab0d60ac1` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:59.052913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e95e214c0d4416ea1e0f22ab0d60ac1)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:59.070170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1058/2124] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:39:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:39:59.078695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f8355-4020-4b18-878d-3d524beff55a None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:59.106200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f8355-4020-4b18-878d-3d524beff55a None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:59.113165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:59.114562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:59.116428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:59.118221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:59.118977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:59.121281 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:39:59.122261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:59.235942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e95e214c0d4416ea1e0f22ab0d60ac1'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.261045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e95e214c0d4416ea1e0f22ab0d60ac1'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.262488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e95e214c0d4416ea1e0f22ab0d60ac1'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.282173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e95e214c0d4416ea1e0f22ab0d60ac1'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.302363 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:59.310470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e95e214c0d4416ea1e0f22ab0d60ac1'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:39:59.322557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1059/2125] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:39:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:39:59.324072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1067/2126] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:39:58 2021] DELETE /identity/v3/users/5e95e214c0d4416ea1e0f22ab0d60ac1 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:39:59.332105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:59.333751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:39:59.366918 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb359b-190a-4e93-a447-4bc8d100f92d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:59.600342 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e574f-d2a6-4d6f-9b02-937d51a5f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:59.601830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e574f-d2a6-4d6f-9b02-937d51a5f909 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:59.603149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e574f-d2a6-4d6f-9b02-937d51a5f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:59.604089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e574f-d2a6-4d6f-9b02-937d51a5f909 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:59.605519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e574f-d2a6-4d6f-9b02-937d51a5f909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:59.669778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e574f-d2a6-4d6f-9b02-937d51a5f909 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:59.728862 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1060/2127] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:39:59 2021] POST /identity/v3/projects => generated 385 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:39:59.731294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:39:59.756935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ab975-e290-4190-b3e5-d1395ecf99ee admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:39:59.915259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae63107-1ff0-4127-9d6e-426d8fafcee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:39:59.916703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63107-1ff0-4127-9d6e-426d8fafcee7 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:39:59.916703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63107-1ff0-4127-9d6e-426d8fafcee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:39:59.916978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63107-1ff0-4127-9d6e-426d8fafcee7 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:39:59.917923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae63107-1ff0-4127-9d6e-426d8fafcee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:39:59.953797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae63107-1ff0-4127-9d6e-426d8fafcee7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:39:59.990966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1068/2128] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:39:59 2021] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:39:59.997511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e574f-d2a6-4d6f-9b02-937d51a5f909 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:00.018132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e574f-d2a6-4d6f-9b02-937d51a5f909 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:00.026722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bfce1-c6d0-4e94-a603-395420879175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:00.028240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bfce1-c6d0-4e94-a603-395420879175 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.029083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bfce1-c6d0-4e94-a603-395420879175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.029835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bfce1-c6d0-4e94-a603-395420879175 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.031679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bfce1-c6d0-4e94-a603-395420879175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:00.089350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bfce1-c6d0-4e94-a603-395420879175 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:00.157166 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1061/2129] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:39:59 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:00.164822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae63107-1ff0-4127-9d6e-426d8fafcee7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:00.189545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae63107-1ff0-4127-9d6e-426d8fafcee7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:00.207865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb46a1-5fa0-4ec5-b6e3-81f1449dceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:00.209363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb46a1-5fa0-4ec5-b6e3-81f1449dceec admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.209818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb46a1-5fa0-4ec5-b6e3-81f1449dceec admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.213530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb46a1-5fa0-4ec5-b6e3-81f1449dceec admin admin] PATH_INFO: `/v3/projects/e7c08362bb0b488db1a1b7562e6e1451/users/fb81c28d208842c0a67bfff35b1b54f3/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.281373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb46a1-5fa0-4ec5-b6e3-81f1449dceec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c08362bb0b488db1a1b7562e6e1451, user_id=fb81c28d208842c0a67bfff35b1b54f3, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:00.354079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb46a1-5fa0-4ec5-b6e3-81f1449dceec admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:00.382153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1069/2130] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:00 2021] PUT /identity/v3/projects/e7c08362bb0b488db1a1b7562e6e1451/users/fb81c28d208842c0a67bfff35b1b54f3/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:00.398308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3aae-1aaa-4d62-a919-c95151673cc1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.398847 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3aae-1aaa-4d62-a919-c95151673cc1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.399345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3aae-1aaa-4d62-a919-c95151673cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.538674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-976e3aae-1aaa-4d62-a919-c95151673cc1 None None] MFA Rules not processed for user `fb81c28d208842c0a67bfff35b1b54f3`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:00.540741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-976e3aae-1aaa-4d62-a919-c95151673cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:00.623213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb46a1-5fa0-4ec5-b6e3-81f1449dceec admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:00.626453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ecdb46a1-5fa0-4ec5-b6e3-81f1449dceec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:00.746644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1062/2131] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:00 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:00.748354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3aae-1aaa-4d62-a919-c95151673cc1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:00.751448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-976e3aae-1aaa-4d62-a919-c95151673cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:00.912669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb46a1-5fa0-4ec5-b6e3-81f1449dceec admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:00.936086 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:00.937617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:00.938151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:00.938609 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] PATH_INFO: `/v3/projects/7d103c5e52074bd195520d241e6ff30b` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:00.941190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d103c5e52074bd195520d241e6ff30b)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:00.998171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:01.106805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3aae-1aaa-4d62-a919-c95151673cc1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.147020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d103c5e52074bd195520d241e6ff30b', 'request_id': 'req-545c60d7-603f-4234-8860-f202a9fa5c49'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.184453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d103c5e52074bd195520d241e6ff30b', 'request_id': 'req-545c60d7-603f-4234-8860-f202a9fa5c49'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.195727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d103c5e52074bd195520d241e6ff30b', 'request_id': 'req-545c60d7-603f-4234-8860-f202a9fa5c49'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.210340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] The token cache is being invalidate because project 7d103c5e52074bd195520d241e6ff30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:01.210774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.212058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.217241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1070/2132] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:00 2021] DELETE /identity/v3/projects/7d103c5e52074bd195520d241e6ff30b => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:01.219316 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.221324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.324764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.326797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.327295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.327867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] PATH_INFO: `/v3/projects/9fdf4de0f0bf4a0489acd12bc56bf9d9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.330075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdf4de0f0bf4a0489acd12bc56bf9d9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:01.409567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:01.409907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c60d7-603f-4234-8860-f202a9fa5c49 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.415614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a05fb6-a4c8-450f-ac14-4d3c74197a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.416354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a05fb6-a4c8-450f-ac14-4d3c74197a90 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.416707 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a05fb6-a4c8-450f-ac14-4d3c74197a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.417059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a05fb6-a4c8-450f-ac14-4d3c74197a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.418071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a05fb6-a4c8-450f-ac14-4d3c74197a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:01.453062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a05fb6-a4c8-450f-ac14-4d3c74197a90 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:01.510078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1071/2133] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:01 2021] POST /identity/v3/projects => generated 383 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:01.517366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bcab6-b082-4606-8af9-7728b5ebcb1c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.519095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bcab6-b082-4606-8af9-7728b5ebcb1c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.519367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bcab6-b082-4606-8af9-7728b5ebcb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.542466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdf4de0f0bf4a0489acd12bc56bf9d9', 'request_id': 'req-eb5de030-3bc6-4950-a013-ec498868410a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.568364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdf4de0f0bf4a0489acd12bc56bf9d9', 'request_id': 'req-eb5de030-3bc6-4950-a013-ec498868410a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.579237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdf4de0f0bf4a0489acd12bc56bf9d9', 'request_id': 'req-eb5de030-3bc6-4950-a013-ec498868410a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.580737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-a69bcab6-b082-4606-8af9-7728b5ebcb1c None None] MFA Rules not processed for user `f8c9d652402e4465b4820436357bdc72`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:01.586670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a69bcab6-b082-4606-8af9-7728b5ebcb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.593778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] The token cache is being invalidate because project 9fdf4de0f0bf4a0489acd12bc56bf9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:01.594288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.595148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:01.602691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1063/2134] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:00 2021] DELETE /identity/v3/projects/9fdf4de0f0bf4a0489acd12bc56bf9d9 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:01.603849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.606629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.711274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1072/2135] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:01 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:01.712153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bcab6-b082-4606-8af9-7728b5ebcb1c None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:01.713635 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a69bcab6-b082-4606-8af9-7728b5ebcb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:01.767761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5de030-3bc6-4950-a013-ec498868410a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.901261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bcab6-b082-4606-8af9-7728b5ebcb1c None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:01.913416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c43409-3b5a-439d-9892-01dbfad981fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.914514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c43409-3b5a-439d-9892-01dbfad981fe admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.914514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c43409-3b5a-439d-9892-01dbfad981fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.915254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c43409-3b5a-439d-9892-01dbfad981fe admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.924829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c43409-3b5a-439d-9892-01dbfad981fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:01.926629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:01.927576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:01.927883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:01.928166 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] PATH_INFO: `/v3/users/5c0e86376f084d12ac20b349bafa45f0` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:01.933539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0e86376f084d12ac20b349bafa45f0)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:01.995768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c43409-3b5a-439d-9892-01dbfad981fe admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.016406 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.046126 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1073/2136] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:01 2021] POST /identity/v3/users => generated 298 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:02.052836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f31c-31df-41bd-9abb-4514ff1dfd43 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.057576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f31c-31df-41bd-9abb-4514ff1dfd43 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.057855 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f31c-31df-41bd-9abb-4514ff1dfd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.137803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9f40f31c-31df-41bd-9abb-4514ff1dfd43 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:02.140609 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9f40f31c-31df-41bd-9abb-4514ff1dfd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:02.155424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1074/2137] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:02.157005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40f31c-31df-41bd-9abb-4514ff1dfd43 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.167437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0e86376f084d12ac20b349bafa45f0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:02.191375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0e86376f084d12ac20b349bafa45f0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:02.215072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0e86376f084d12ac20b349bafa45f0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:02.215336 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40f31c-31df-41bd-9abb-4514ff1dfd43 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.217081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0e86376f084d12ac20b349bafa45f0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:02.231385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de7bf9-d3c1-4162-9e3b-749c9f85c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.232357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de7bf9-d3c1-4162-9e3b-749c9f85c61b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.232794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de7bf9-d3c1-4162-9e3b-749c9f85c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.233253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de7bf9-d3c1-4162-9e3b-749c9f85c61b admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.234354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a5d721cb-212a-48d4-bdf6-2c6259ca0109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0e86376f084d12ac20b349bafa45f0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:02.252543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1064/2138] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:01 2021] DELETE /identity/v3/users/5c0e86376f084d12ac20b349bafa45f0 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:02.256208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de7bf9-d3c1-4162-9e3b-749c9f85c61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:02.260038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddca7f-5730-4e49-8775-f2e48e9d8c03 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.261167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddca7f-5730-4e49-8775-f2e48e9d8c03 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.261488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddca7f-5730-4e49-8775-f2e48e9d8c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.326795 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-78ddca7f-5730-4e49-8775-f2e48e9d8c03 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:02.355777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-78ddca7f-5730-4e49-8775-f2e48e9d8c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:02.359424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de7bf9-d3c1-4162-9e3b-749c9f85c61b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.399275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1075/2139] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:02.404786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de7bf9-d3c1-4162-9e3b-749c9f85c61b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.408439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f5de7bf9-d3c1-4162-9e3b-749c9f85c61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:02.444881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de7bf9-d3c1-4162-9e3b-749c9f85c61b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.576602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1065/2140] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:02.578185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddca7f-5730-4e49-8775-f2e48e9d8c03 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.595388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddca7f-5730-4e49-8775-f2e48e9d8c03 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.614236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a68b-4d4e-40b6-9005-3b76afe227b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.614970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a68b-4d4e-40b6-9005-3b76afe227b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.615267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a68b-4d4e-40b6-9005-3b76afe227b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.615538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a68b-4d4e-40b6-9005-3b76afe227b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.616395 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948a68b-4d4e-40b6-9005-3b76afe227b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:40:02.616858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948a68b-4d4e-40b6-9005-3b76afe227b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:02.632140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69426c60-ddb1-4f4d-b52f-c309ac8d4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.634526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69426c60-ddb1-4f4d-b52f-c309ac8d4e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.635041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69426c60-ddb1-4f4d-b52f-c309ac8d4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.635543 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69426c60-ddb1-4f4d-b52f-c309ac8d4e29 admin admin] PATH_INFO: `/v3/projects/b1663f4005664eb284d72b1a6f5e9d1d/users/8372c82512674176949b418754d49cec/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.716528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948a68b-4d4e-40b6-9005-3b76afe227b8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.722719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69426c60-ddb1-4f4d-b52f-c309ac8d4e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1663f4005664eb284d72b1a6f5e9d1d, user_id=8372c82512674176949b418754d49cec, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:02.774825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1066/2141] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:02.778067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a68b-4d4e-40b6-9005-3b76afe227b8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.802934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a68b-4d4e-40b6-9005-3b76afe227b8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:02.806305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69426c60-ddb1-4f4d-b52f-c309ac8d4e29 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:02.820695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6b150-2f74-4e42-b7ea-1884f0af9b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:02.821620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6b150-2f74-4e42-b7ea-1884f0af9b69 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:02.822093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6b150-2f74-4e42-b7ea-1884f0af9b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:02.822567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6b150-2f74-4e42-b7ea-1884f0af9b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:02.823592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6b150-2f74-4e42-b7ea-1884f0af9b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:02.871376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1076/2142] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:02 2021] PUT /identity/v3/projects/b1663f4005664eb284d72b1a6f5e9d1d/users/8372c82512674176949b418754d49cec/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:02.876817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69426c60-ddb1-4f4d-b52f-c309ac8d4e29 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:02.935896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6b150-2f74-4e42-b7ea-1884f0af9b69 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.016215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1067/2143] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:02 2021] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:03.021622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6b150-2f74-4e42-b7ea-1884f0af9b69 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.049570 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69426c60-ddb1-4f4d-b52f-c309ac8d4e29 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.162814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6b150-2f74-4e42-b7ea-1884f0af9b69 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.187474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e33ae2-04ab-4299-be4f-294367f08e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.188793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e33ae2-04ab-4299-be4f-294367f08e39 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.189800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e33ae2-04ab-4299-be4f-294367f08e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.191984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e33ae2-04ab-4299-be4f-294367f08e39 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.195734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e33ae2-04ab-4299-be4f-294367f08e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:03.286056 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e33ae2-04ab-4299-be4f-294367f08e39 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.349951 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359c5c-8cf9-43da-b565-0c4a52ebae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.351080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359c5c-8cf9-43da-b565-0c4a52ebae39 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.351675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359c5c-8cf9-43da-b565-0c4a52ebae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.352115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359c5c-8cf9-43da-b565-0c4a52ebae39 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.356903 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359c5c-8cf9-43da-b565-0c4a52ebae39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:03.385395 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1068/2144] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:03 2021] POST /identity/v3/users => generated 287 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:03.387058 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e33ae2-04ab-4299-be4f-294367f08e39 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.430334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e33ae2-04ab-4299-be4f-294367f08e39 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.447347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80538488-732f-448e-97f1-32339940e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.448246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80538488-732f-448e-97f1-32339940e5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.449271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80538488-732f-448e-97f1-32339940e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.449763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80538488-732f-448e-97f1-32339940e5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.454746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80538488-732f-448e-97f1-32339940e5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:03.477399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359c5c-8cf9-43da-b565-0c4a52ebae39 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.507344 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1077/2145] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 631 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:03.508928 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359c5c-8cf9-43da-b565-0c4a52ebae39 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.527289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359c5c-8cf9-43da-b565-0c4a52ebae39 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.537692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912d41-26d3-4a20-ab2b-fcd0510368ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.537692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912d41-26d3-4a20-ab2b-fcd0510368ed admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.537692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912d41-26d3-4a20-ab2b-fcd0510368ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.537692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912d41-26d3-4a20-ab2b-fcd0510368ed admin admin] PATH_INFO: `/v3/projects/b1663f4005664eb284d72b1a6f5e9d1d/users/8372c82512674176949b418754d49cec/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.544223 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93912d41-26d3-4a20-ab2b-fcd0510368ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1663f4005664eb284d72b1a6f5e9d1d, user_id=8372c82512674176949b418754d49cec, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:03.568714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80538488-732f-448e-97f1-32339940e5c2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.607111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93912d41-26d3-4a20-ab2b-fcd0510368ed admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:03.630711 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1078/2146] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:03 2021] PUT /identity/v3/projects/b1663f4005664eb284d72b1a6f5e9d1d/users/8372c82512674176949b418754d49cec/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:03.637642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1069/2147] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:03 2021] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:03.641940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912d41-26d3-4a20-ab2b-fcd0510368ed admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.643949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80538488-732f-448e-97f1-32339940e5c2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:03.684314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80538488-732f-448e-97f1-32339940e5c2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.961848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912d41-26d3-4a20-ab2b-fcd0510368ed admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:03.964542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b31cc2-01d0-431c-833b-dc674d737e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.966085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b31cc2-01d0-431c-833b-dc674d737e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.966478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b31cc2-01d0-431c-833b-dc674d737e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.966942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b31cc2-01d0-431c-833b-dc674d737e10 admin admin] PATH_INFO: `/v3/projects/3d879a6e3e0e44f9a8dd8103e6d04739/users/61e7b6ace2d74dd7b8da40eb7be5548c/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.967887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9572e-364a-4cf9-ba3d-ee3c0012c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:03.968820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9572e-364a-4cf9-ba3d-ee3c0012c58d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:03.969117 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9572e-364a-4cf9-ba3d-ee3c0012c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:03.969402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9572e-364a-4cf9-ba3d-ee3c0012c58d admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:03.970177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9572e-364a-4cf9-ba3d-ee3c0012c58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:04.039559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9572e-364a-4cf9-ba3d-ee3c0012c58d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.046895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b31cc2-01d0-431c-833b-dc674d737e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d879a6e3e0e44f9a8dd8103e6d04739, user_id=61e7b6ace2d74dd7b8da40eb7be5548c, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:04.058083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1079/2148] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:03 2021] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:04.066541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9572e-364a-4cf9-ba3d-ee3c0012c58d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:04.080672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9572e-364a-4cf9-ba3d-ee3c0012c58d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:04.087425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7060e0-a274-4b7b-91d7-1b74b82520e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:04.088917 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7060e0-a274-4b7b-91d7-1b74b82520e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.089507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7060e0-a274-4b7b-91d7-1b74b82520e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.090077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7060e0-a274-4b7b-91d7-1b74b82520e7 admin admin] PATH_INFO: `/v3/projects/b1663f4005664eb284d72b1a6f5e9d1d/users/8372c82512674176949b418754d49cec/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.092622 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7060e0-a274-4b7b-91d7-1b74b82520e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1663f4005664eb284d72b1a6f5e9d1d, user_id=8372c82512674176949b418754d49cec, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:04.152559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b31cc2-01d0-431c-833b-dc674d737e10 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.200576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1070/2149] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:03 2021] PUT /identity/v3/projects/3d879a6e3e0e44f9a8dd8103e6d04739/users/61e7b6ace2d74dd7b8da40eb7be5548c/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:04.215099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7060e0-a274-4b7b-91d7-1b74b82520e7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.222326 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a943ee-1283-4e71-a2a5-b97491a56489 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.222824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a943ee-1283-4e71-a2a5-b97491a56489 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.224160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a943ee-1283-4e71-a2a5-b97491a56489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.258646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1080/2150] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:04 2021] PUT /identity/v3/projects/b1663f4005664eb284d72b1a6f5e9d1d/users/8372c82512674176949b418754d49cec/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:04.263070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7060e0-a274-4b7b-91d7-1b74b82520e7 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:04.269781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1b7060e0-a274-4b7b-91d7-1b74b82520e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:04.306780 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-f9a943ee-1283-4e71-a2a5-b97491a56489 None None] MFA Rules not processed for user `61e7b6ace2d74dd7b8da40eb7be5548c`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:04.309394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f9a943ee-1283-4e71-a2a5-b97491a56489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:04.420025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7060e0-a274-4b7b-91d7-1b74b82520e7 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:04.426129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:04.427094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.427461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.427815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] PATH_INFO: `/v3/projects/e167727db5dd4d97bc42b47d4c956b5c` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.429418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e167727db5dd4d97bc42b47d4c956b5c)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:04.500986 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1071/2151] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:04 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:04.503359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada154e-a268-4efe-81cb-9e846afdd1a8 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.503851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada154e-a268-4efe-81cb-9e846afdd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.504399 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada154e-a268-4efe-81cb-9e846afdd1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:04.515237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:04.609082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-eada154e-a268-4efe-81cb-9e846afdd1a8 None None] MFA Rules not processed for user `8372c82512674176949b418754d49cec`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:04.611160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-eada154e-a268-4efe-81cb-9e846afdd1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:04.674107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e167727db5dd4d97bc42b47d4c956b5c', 'request_id': 'req-9b4022aa-2691-416a-8853-63a743d67d87'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:04.730462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e167727db5dd4d97bc42b47d4c956b5c', 'request_id': 'req-9b4022aa-2691-416a-8853-63a743d67d87'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:04.747706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e167727db5dd4d97bc42b47d4c956b5c', 'request_id': 'req-9b4022aa-2691-416a-8853-63a743d67d87'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:04.773669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] The token cache is being invalidate because project e167727db5dd4d97bc42b47d4c956b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:04.774144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:04.774859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:04.776778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1081/2152] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:04 2021] DELETE /identity/v3/projects/e167727db5dd4d97bc42b47d4c956b5c => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:04.779044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:04.783120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:04.889808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1072/2153] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:04 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:04.895144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111e22-0433-4c26-b926-ddfb13ffd90e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:04.902022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111e22-0433-4c26-b926-ddfb13ffd90e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:04.904365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111e22-0433-4c26-b926-ddfb13ffd90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.023239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a4111e22-0433-4c26-b926-ddfb13ffd90e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:05.025170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a4111e22-0433-4c26-b926-ddfb13ffd90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.035978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4022aa-2691-416a-8853-63a743d67d87 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.043884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17ce2b-de1a-454c-a02e-bd4a07ac8ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.044830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ce2b-de1a-454c-a02e-bd4a07ac8ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.045322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ce2b-de1a-454c-a02e-bd4a07ac8ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.046932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ce2b-de1a-454c-a02e-bd4a07ac8ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.051541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7e17ce2b-de1a-454c-a02e-bd4a07ac8ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.284372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17ce2b-de1a-454c-a02e-bd4a07ac8ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:05.291125 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1073/2154] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:05.292582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4111e22-0433-4c26-b926-ddfb13ffd90e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.294632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a4111e22-0433-4c26-b926-ddfb13ffd90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.318446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4111e22-0433-4c26-b926-ddfb13ffd90e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.332480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bd158-7957-47ee-b39b-55d7e64c86e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.333571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bd158-7957-47ee-b39b-55d7e64c86e6 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.334085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bd158-7957-47ee-b39b-55d7e64c86e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.334581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bd158-7957-47ee-b39b-55d7e64c86e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.338950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-512bd158-7957-47ee-b39b-55d7e64c86e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.366478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17ce2b-de1a-454c-a02e-bd4a07ac8ac4 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.389503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1082/2155] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:04 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:05.401078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f868-56b5-41f2-9827-a2156947bc84 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.401377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f868-56b5-41f2-9827-a2156947bc84 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.401662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f868-56b5-41f2-9827-a2156947bc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.523388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3414f868-56b5-41f2-9827-a2156947bc84 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:05.526241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3414f868-56b5-41f2-9827-a2156947bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.572924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1083/2156] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:05.575229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bd158-7957-47ee-b39b-55d7e64c86e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:05.575425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414f868-56b5-41f2-9827-a2156947bc84 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.579396 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3414f868-56b5-41f2-9827-a2156947bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.620915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414f868-56b5-41f2-9827-a2156947bc84 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.634137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.635187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.635630 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.636080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] PATH_INFO: `/v3/users/61e7b6ace2d74dd7b8da40eb7be5548c` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.640226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bd158-7957-47ee-b39b-55d7e64c86e6 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.647053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e7b6ace2d74dd7b8da40eb7be5548c)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:05.694957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1074/2157] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:05 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:05.699232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bd158-7957-47ee-b39b-55d7e64c86e6 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:05.709420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:05.741837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bd158-7957-47ee-b39b-55d7e64c86e6 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:05.770134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:05.770948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.771290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.771589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.772353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:40:05.772657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:05.836308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e7b6ace2d74dd7b8da40eb7be5548c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.848496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e7b6ace2d74dd7b8da40eb7be5548c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.850094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e7b6ace2d74dd7b8da40eb7be5548c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.871302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e7b6ace2d74dd7b8da40eb7be5548c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.893763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33af61c9-b66a-4254-bc2f-ddfd684adc8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e7b6ace2d74dd7b8da40eb7be5548c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:05.904457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1084/2158] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:05 2021] DELETE /identity/v3/users/61e7b6ace2d74dd7b8da40eb7be5548c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:05.913126 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2860e0-d836-435c-b1d4-e41087de1d91 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:05.913571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2860e0-d836-435c-b1d4-e41087de1d91 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:05.914042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2860e0-d836-435c-b1d4-e41087de1d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:05.969129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-8d2860e0-d836-435c-b1d4-e41087de1d91 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:05.971757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8d2860e0-d836-435c-b1d4-e41087de1d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:05.978212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.081869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1075/2159] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:06.088919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.092876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.167994 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45929699-2983-4813-a08f-0c2b08f89802 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.227265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1085/2160] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:06.244326 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2860e0-d836-435c-b1d4-e41087de1d91 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.245774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8d2860e0-d836-435c-b1d4-e41087de1d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:06.356479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486068-bcfe-4cd9-bd8e-0c72c0206713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.357825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486068-bcfe-4cd9-bd8e-0c72c0206713 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.358608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486068-bcfe-4cd9-bd8e-0c72c0206713 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.359368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486068-bcfe-4cd9-bd8e-0c72c0206713 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.360714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486068-bcfe-4cd9-bd8e-0c72c0206713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:06.433305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2860e0-d836-435c-b1d4-e41087de1d91 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.448850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bfdad-75c7-4e21-9e6c-7dae2b9aeae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.449824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bfdad-75c7-4e21-9e6c-7dae2b9aeae3 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.454104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bfdad-75c7-4e21-9e6c-7dae2b9aeae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.454634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bfdad-75c7-4e21-9e6c-7dae2b9aeae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.466236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486068-bcfe-4cd9-bd8e-0c72c0206713 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.490607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bfdad-75c7-4e21-9e6c-7dae2b9aeae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:06.544519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1076/2161] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:06 2021] POST /identity/v3/projects => generated 359 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:06.548537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486068-bcfe-4cd9-bd8e-0c72c0206713 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:06.581352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bfdad-75c7-4e21-9e6c-7dae2b9aeae3 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:06.635918 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1086/2162] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:06.824407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486068-bcfe-4cd9-bd8e-0c72c0206713 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:06.833140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12fa83-4572-4d96-af7c-3b1f0e648fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:06.834278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12fa83-4572-4d96-af7c-3b1f0e648fbd admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:06.834757 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12fa83-4572-4d96-af7c-3b1f0e648fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:06.835237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12fa83-4572-4d96-af7c-3b1f0e648fbd admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:06.844129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12fa83-4572-4d96-af7c-3b1f0e648fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:06.949384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12fa83-4572-4d96-af7c-3b1f0e648fbd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.019503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1077/2163] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:06 2021] POST /identity/v3/users => generated 280 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:07.022934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bfdad-75c7-4e21-9e6c-7dae2b9aeae3 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.056558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bfdad-75c7-4e21-9e6c-7dae2b9aeae3 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.073522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a37df7-1722-4a8d-8a78-7f0974cb4dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.074642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37df7-1722-4a8d-8a78-7f0974cb4dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.075156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37df7-1722-4a8d-8a78-7f0974cb4dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.075690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37df7-1722-4a8d-8a78-7f0974cb4dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.078563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a37df7-1722-4a8d-8a78-7f0974cb4dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:07.229281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a37df7-1722-4a8d-8a78-7f0974cb4dc6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.276101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12fa83-4572-4d96-af7c-3b1f0e648fbd admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:07.280860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1087/2164] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:07 2021] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:07.313241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12fa83-4572-4d96-af7c-3b1f0e648fbd admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:07.346342 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6a51f-57f8-4238-8c31-5665352467ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:07.349806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6a51f-57f8-4238-8c31-5665352467ae admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.352104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6a51f-57f8-4238-8c31-5665352467ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.354152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6a51f-57f8-4238-8c31-5665352467ae admin admin] PATH_INFO: `/v3/projects/633c86a647584e0fbaaf9a39b180530a/users/6a6bd449097e40248c4dbb1d28899233/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.467418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6a51f-57f8-4238-8c31-5665352467ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=633c86a647584e0fbaaf9a39b180530a, user_id=6a6bd449097e40248c4dbb1d28899233, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:07.613909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6a51f-57f8-4238-8c31-5665352467ae admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:07.679525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1078/2165] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:07 2021] PUT /identity/v3/projects/633c86a647584e0fbaaf9a39b180530a/users/6a6bd449097e40248c4dbb1d28899233/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:07.695011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6555a9-f50b-4e98-92dd-409e9e79a55c None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:07.695942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6555a9-f50b-4e98-92dd-409e9e79a55c None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:07.695942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6555a9-f50b-4e98-92dd-409e9e79a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:07.836709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-dd6555a9-f50b-4e98-92dd-409e9e79a55c None None] MFA Rules not processed for user `6a6bd449097e40248c4dbb1d28899233`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:07.840547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-dd6555a9-f50b-4e98-92dd-409e9e79a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.133982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1088/2166] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:07 2021] POST /identity/v3/auth/tokens => generated 3666 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:08.188428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da19f6-bf5c-4c4a-a179-a8a792ff68ca None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.188917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da19f6-bf5c-4c4a-a179-a8a792ff68ca None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.189751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da19f6-bf5c-4c4a-a179-a8a792ff68ca None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.194153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1079/2167] 10.222.0.67 () {54 vars in 961 bytes} [Thu Dec 16 14:40:08 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:40:08.203196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83527f-c313-44fd-a2b6-94dfc6c25ee2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.203737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83527f-c313-44fd-a2b6-94dfc6c25ee2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.204246 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83527f-c313-44fd-a2b6-94dfc6c25ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.277657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da19f6-bf5c-4c4a-a179-a8a792ff68ca None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.280784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-70da19f6-bf5c-4c4a-a179-a8a792ff68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.296795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-bc83527f-c313-44fd-a2b6-94dfc6c25ee2 None None] MFA Rules not processed for user `bb089e686c2540bfadf60b8ea010e441`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:08.301268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-bc83527f-c313-44fd-a2b6-94dfc6c25ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.472992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1089/2168] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Dec 16 14:40:08 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:08.489934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83527f-c313-44fd-a2b6-94dfc6c25ee2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.502523 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da19f6-bf5c-4c4a-a179-a8a792ff68ca None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.506526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83527f-c313-44fd-a2b6-94dfc6c25ee2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:08.509352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.511264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.511748 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.512215 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] PATH_INFO: `/v3/projects/3d879a6e3e0e44f9a8dd8103e6d04739` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.512441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0ec1e-c276-4972-ad8a-3e8910f711fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:08.513770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0ec1e-c276-4972-ad8a-3e8910f711fe service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.514235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0ec1e-c276-4972-ad8a-3e8910f711fe service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.514390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d879a6e3e0e44f9a8dd8103e6d04739)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:08.514567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0ec1e-c276-4972-ad8a-3e8910f711fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.532380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0ec1e-c276-4972-ad8a-3e8910f711fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:08.573378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.588885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0ec1e-c276-4972-ad8a-3e8910f711fe service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:08.613415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1090/2169] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:08 2021] GET /identity/v3/auth/tokens => generated 3666 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:08.661560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d879a6e3e0e44f9a8dd8103e6d04739', 'request_id': 'req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.679152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d879a6e3e0e44f9a8dd8103e6d04739', 'request_id': 'req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.690313 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d879a6e3e0e44f9a8dd8103e6d04739', 'request_id': 'req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.708522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] The token cache is being invalidate because project 3d879a6e3e0e44f9a8dd8103e6d04739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:08.708909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.709953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-46d13e18-b9c8-4310-a45d-f66c6c2a9c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:08.717865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1080/2170] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:08 2021] DELETE /identity/v3/projects/3d879a6e3e0e44f9a8dd8103e6d04739 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:08.722537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eba3a-fbd5-4fd3-b4de-e1e6fa9d1d05 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.723305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eba3a-fbd5-4fd3-b4de-e1e6fa9d1d05 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.723626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eba3a-fbd5-4fd3-b4de-e1e6fa9d1d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.775911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-767eba3a-fbd5-4fd3-b4de-e1e6fa9d1d05 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:08.778667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-767eba3a-fbd5-4fd3-b4de-e1e6fa9d1d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.902590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af4b96-d000-401e-a805-95c633e7eaa6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:08.903715 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af4b96-d000-401e-a805-95c633e7eaa6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:08.904124 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af4b96-d000-401e-a805-95c633e7eaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:08.914201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1091/2171] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:08.943502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-54af4b96-d000-401e-a805-95c633e7eaa6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:08.945532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-54af4b96-d000-401e-a805-95c633e7eaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:08.965271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1081/2172] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:08.970602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eba3a-fbd5-4fd3-b4de-e1e6fa9d1d05 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:08.994238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eba3a-fbd5-4fd3-b4de-e1e6fa9d1d05 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.002138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.002939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.003708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.004252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.004944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:40:09.005372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:09.039295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.062469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1092/2173] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:09.065657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af4b96-d000-401e-a805-95c633e7eaa6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.079338 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af4b96-d000-401e-a805-95c633e7eaa6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.098578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7b32e-e166-42cf-b74a-08df420b2d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.100097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b32e-e166-42cf-b74a-08df420b2d0d admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.100388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b32e-e166-42cf-b74a-08df420b2d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.103072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b32e-e166-42cf-b74a-08df420b2d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.103787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7b32e-e166-42cf-b74a-08df420b2d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:09.189089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7b32e-e166-42cf-b74a-08df420b2d0d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.190823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.193963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:09.244388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b7a79-b533-4c82-b4fe-f56136e5eebc admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.269852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.271893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.273605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.276247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] PATH_INFO: `/v3/users/6a6bd449097e40248c4dbb1d28899233` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.280218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6bd449097e40248c4dbb1d28899233)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:09.281007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1082/2174] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:09 2021] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:09.288086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7b32e-e166-42cf-b74a-08df420b2d0d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.371409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.501737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7b32e-e166-42cf-b74a-08df420b2d0d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.524839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d87f-929d-49b0-8d5f-8affb69f9d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:09.527722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d87f-929d-49b0-8d5f-8affb69f9d79 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.528311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d87f-929d-49b0-8d5f-8affb69f9d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.528786 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d87f-929d-49b0-8d5f-8affb69f9d79 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.545504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d87f-929d-49b0-8d5f-8affb69f9d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:09.562915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6bd449097e40248c4dbb1d28899233'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.614037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6bd449097e40248c4dbb1d28899233'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.615179 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6bd449097e40248c4dbb1d28899233'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.629208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6bd449097e40248c4dbb1d28899233'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.661691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d87f-929d-49b0-8d5f-8affb69f9d79 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:09.665717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-8ae7fd3a-3d00-45c6-b4f9-1a132b336980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6bd449097e40248c4dbb1d28899233'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:09.691862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1093/2175] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:09 2021] DELETE /identity/v3/users/6a6bd449097e40248c4dbb1d28899233 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:09.694539 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6e519-f75a-4369-af63-aab9803b1d84 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:09.695029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6e519-f75a-4369-af63-aab9803b1d84 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:09.695512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6e519-f75a-4369-af63-aab9803b1d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:09.739980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1083/2176] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:09 2021] POST /identity/v3/users => generated 287 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:09.742482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d87f-929d-49b0-8d5f-8affb69f9d79 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.752967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8d07d87f-929d-49b0-8d5f-8affb69f9d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:09.790877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d87f-929d-49b0-8d5f-8affb69f9d79 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:09.800285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-8eb6e519-f75a-4369-af63-aab9803b1d84 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:09.804654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8eb6e519-f75a-4369-af63-aab9803b1d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:09.934669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1094/2177] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:09.960060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6e519-f75a-4369-af63-aab9803b1d84 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:09.963041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8eb6e519-f75a-4369-af63-aab9803b1d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.014391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eedc32-2d38-44e3-b235-2aba50591f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.015603 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eedc32-2d38-44e3-b235-2aba50591f64 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.016120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eedc32-2d38-44e3-b235-2aba50591f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.016648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eedc32-2d38-44e3-b235-2aba50591f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.018345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eedc32-2d38-44e3-b235-2aba50591f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:10.109111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eedc32-2d38-44e3-b235-2aba50591f64 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.137184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1084/2178] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:09 2021] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:10.139800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eedc32-2d38-44e3-b235-2aba50591f64 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.151704 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eedc32-2d38-44e3-b235-2aba50591f64 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.157537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a0273-1b89-4938-9812-b50d4003969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.158500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a0273-1b89-4938-9812-b50d4003969f admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.158784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a0273-1b89-4938-9812-b50d4003969f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.159064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a0273-1b89-4938-9812-b50d4003969f admin admin] PATH_INFO: `/v3/projects/755abf4383dc4d3ca3ec465e631d8684/users/f642c76a379d43fe97078fb43b7477dc/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.164345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6e519-f75a-4369-af63-aab9803b1d84 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.181203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5deb3f7-af59-46ec-9998-50a301fdbdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.183931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deb3f7-af59-46ec-9998-50a301fdbdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.185840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deb3f7-af59-46ec-9998-50a301fdbdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.186984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a0273-1b89-4938-9812-b50d4003969f admin admin] RBAC: Authorizing `identity:create_grant(project_id=755abf4383dc4d3ca3ec465e631d8684, user_id=f642c76a379d43fe97078fb43b7477dc, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:10.188414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deb3f7-af59-46ec-9998-50a301fdbdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.225376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a0273-1b89-4938-9812-b50d4003969f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.239472 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5deb3f7-af59-46ec-9998-50a301fdbdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:10.267636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1085/2179] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:10 2021] PUT /identity/v3/projects/755abf4383dc4d3ca3ec465e631d8684/users/f642c76a379d43fe97078fb43b7477dc/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:10.270685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac592e9-9b95-4fa0-95fe-49c78fee4995 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.271861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac592e9-9b95-4fa0-95fe-49c78fee4995 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.274472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac592e9-9b95-4fa0-95fe-49c78fee4995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.333753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5deb3f7-af59-46ec-9998-50a301fdbdd8 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:10.347296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-dac592e9-9b95-4fa0-95fe-49c78fee4995 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:10.350035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-dac592e9-9b95-4fa0-95fe-49c78fee4995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:10.376518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1095/2180] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:10.555927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1086/2181] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:10.634751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5deb3f7-af59-46ec-9998-50a301fdbdd8 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:10.649972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5deb3f7-af59-46ec-9998-50a301fdbdd8 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:10.863315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e175600-1788-437d-8d17-a19b2ddc7651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:10.864755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e175600-1788-437d-8d17-a19b2ddc7651 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:10.865599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e175600-1788-437d-8d17-a19b2ddc7651 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:10.866112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e175600-1788-437d-8d17-a19b2ddc7651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:10.914847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e175600-1788-437d-8d17-a19b2ddc7651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:11.074386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e175600-1788-437d-8d17-a19b2ddc7651 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:11.087986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1096/2182] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:12.647626 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac592e9-9b95-4fa0-95fe-49c78fee4995 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:12.650699 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-dac592e9-9b95-4fa0-95fe-49c78fee4995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:12.686929 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac592e9-9b95-4fa0-95fe-49c78fee4995 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:12.700041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:12.703128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:12.704128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:12.705191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] PATH_INFO: `/v3/projects/633c86a647584e0fbaaf9a39b180530a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:12.708686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=633c86a647584e0fbaaf9a39b180530a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:12.778546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:12.894641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633c86a647584e0fbaaf9a39b180530a', 'request_id': 'req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:12.979059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633c86a647584e0fbaaf9a39b180530a', 'request_id': 'req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:13.008447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633c86a647584e0fbaaf9a39b180530a', 'request_id': 'req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:13.062285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] The token cache is being invalidate because project 633c86a647584e0fbaaf9a39b180530a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:13.063158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:13.068510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6e1a671f-25ec-4792-8cab-cf63fbd95b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:13.076206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1087/2183] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:12 2021] DELETE /identity/v3/projects/633c86a647584e0fbaaf9a39b180530a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:13.089056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595316-bb82-4643-81c4-87533911fc69 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.089886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595316-bb82-4643-81c4-87533911fc69 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.090167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595316-bb82-4643-81c4-87533911fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.195987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-04595316-bb82-4643-81c4-87533911fc69 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:13.197508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-04595316-bb82-4643-81c4-87533911fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:13.362821 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1097/2184] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:13.373242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb4d5c-47a9-4860-bc48-41186322599e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.374335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb4d5c-47a9-4860-bc48-41186322599e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.376397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb4d5c-47a9-4860-bc48-41186322599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.442839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-4feb4d5c-47a9-4860-bc48-41186322599e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:13.445266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4feb4d5c-47a9-4860-bc48-41186322599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:13.461761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1088/2185] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:13.468752 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04595316-bb82-4643-81c4-87533911fc69 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.501609 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04595316-bb82-4643-81c4-87533911fc69 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.515992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b653-f848-401a-bc61-0517375dd81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.515992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b653-f848-401a-bc61-0517375dd81e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.515992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b653-f848-401a-bc61-0517375dd81e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.517601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b653-f848-401a-bc61-0517375dd81e admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.518220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b653-f848-401a-bc61-0517375dd81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:40:13.518729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b653-f848-401a-bc61-0517375dd81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:13.558882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b653-f848-401a-bc61-0517375dd81e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.595589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb4d5c-47a9-4860-bc48-41186322599e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.597244 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1098/2186] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:13.615799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb4d5c-47a9-4860-bc48-41186322599e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.630428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a602eb-4a4a-4607-bb1e-dd09456a557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.631072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a602eb-4a4a-4607-bb1e-dd09456a557b admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.631359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a602eb-4a4a-4607-bb1e-dd09456a557b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.631722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a602eb-4a4a-4607-bb1e-dd09456a557b admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.632465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a602eb-4a4a-4607-bb1e-dd09456a557b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:13.684623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a602eb-4a4a-4607-bb1e-dd09456a557b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.728411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1089/2187] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:13 2021] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:13.732869 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b653-f848-401a-bc61-0517375dd81e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:13.747642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b653-f848-401a-bc61-0517375dd81e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:13.863348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa84ec-b7d6-4857-b775-0b96321f1920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:13.864845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa84ec-b7d6-4857-b775-0b96321f1920 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:13.865442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa84ec-b7d6-4857-b775-0b96321f1920 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:13.865875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa84ec-b7d6-4857-b775-0b96321f1920 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:13.867186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa84ec-b7d6-4857-b775-0b96321f1920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:13.927865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa84ec-b7d6-4857-b775-0b96321f1920 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:13.973441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1099/2188] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:13 2021] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:13.976243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a602eb-4a4a-4607-bb1e-dd09456a557b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.000010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a602eb-4a4a-4607-bb1e-dd09456a557b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.010546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd529f-9b6f-4913-a690-dc22f7312088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.012016 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd529f-9b6f-4913-a690-dc22f7312088 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.012709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd529f-9b6f-4913-a690-dc22f7312088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.013275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd529f-9b6f-4913-a690-dc22f7312088 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.015308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd529f-9b6f-4913-a690-dc22f7312088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:14.071955 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd529f-9b6f-4913-a690-dc22f7312088 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:14.094936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1090/2189] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:13 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:14.102319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa84ec-b7d6-4857-b775-0b96321f1920 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.122456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa84ec-b7d6-4857-b775-0b96321f1920 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.131545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb2185-9cd6-4571-a9b4-bfb97615f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.133242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb2185-9cd6-4571-a9b4-bfb97615f354 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.133850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb2185-9cd6-4571-a9b4-bfb97615f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.134496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb2185-9cd6-4571-a9b4-bfb97615f354 admin admin] PATH_INFO: `/v3/projects/cc7e57b949ad4738b3fc88ab569f9be5/users/1d9076505b054ddd93c5441542d6d342/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.181107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb2185-9cd6-4571-a9b4-bfb97615f354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7e57b949ad4738b3fc88ab569f9be5, user_id=1d9076505b054ddd93c5441542d6d342, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:14.251385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb2185-9cd6-4571-a9b4-bfb97615f354 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:14.282494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1100/2190] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:14 2021] PUT /identity/v3/projects/cc7e57b949ad4738b3fc88ab569f9be5/users/1d9076505b054ddd93c5441542d6d342/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:14.296302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1ee7-44db-4588-a19b-1c1b799d7419 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.296745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1ee7-44db-4588-a19b-1c1b799d7419 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.297231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1ee7-44db-4588-a19b-1c1b799d7419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.383616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-187d1ee7-44db-4588-a19b-1c1b799d7419 None None] MFA Rules not processed for user `1d9076505b054ddd93c5441542d6d342`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:14.385611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-187d1ee7-44db-4588-a19b-1c1b799d7419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:14.544996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6d62-cdc3-487e-9b40-0187193836cd None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.545795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6d62-cdc3-487e-9b40-0187193836cd None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.545969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca6d62-cdc3-487e-9b40-0187193836cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.580926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1091/2191] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:14 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:14.588287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1ee7-44db-4588-a19b-1c1b799d7419 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.606293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-12ca6d62-cdc3-487e-9b40-0187193836cd None None] MFA Rules not processed for user `f642c76a379d43fe97078fb43b7477dc`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:14.609351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-12ca6d62-cdc3-487e-9b40-0187193836cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:14.713115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1ee7-44db-4588-a19b-1c1b799d7419 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:14.726344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f64b1-cf32-45b6-ba44-e72030568577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:14.727595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f64b1-cf32-45b6-ba44-e72030568577 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:14.728253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f64b1-cf32-45b6-ba44-e72030568577 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:14.728840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f64b1-cf32-45b6-ba44-e72030568577 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:14.729833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f64b1-cf32-45b6-ba44-e72030568577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:14.793656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f64b1-cf32-45b6-ba44-e72030568577 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:14.805931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1101/2192] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:14 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:14.830354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6d62-cdc3-487e-9b40-0187193836cd None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:14.833827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-12ca6d62-cdc3-487e-9b40-0187193836cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:14.854436 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1092/2193] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:14 2021] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:14.862285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f64b1-cf32-45b6-ba44-e72030568577 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:15.010922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca6d62-cdc3-487e-9b40-0187193836cd None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:15.020289 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f64b1-cf32-45b6-ba44-e72030568577 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:15.028691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c8494-1958-47ef-b960-afcdcff30414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:15.030303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c8494-1958-47ef-b960-afcdcff30414 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:15.031103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c8494-1958-47ef-b960-afcdcff30414 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:15.032409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c8494-1958-47ef-b960-afcdcff30414 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:15.033902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c8494-1958-47ef-b960-afcdcff30414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:15.115382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c8494-1958-47ef-b960-afcdcff30414 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:15.134646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac9a21-5e3a-462a-bca1-c03e16ee287d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:15.136163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac9a21-5e3a-462a-bca1-c03e16ee287d service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:15.137516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac9a21-5e3a-462a-bca1-c03e16ee287d service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:15.138680 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac9a21-5e3a-462a-bca1-c03e16ee287d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:15.175070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1093/2194] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:14 2021] POST /identity/v3/users => generated 294 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:40:15.178017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c8494-1958-47ef-b960-afcdcff30414 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:15.226584 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c8494-1958-47ef-b960-afcdcff30414 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:15.252214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ffbf7-06ec-4b77-8f5e-bb170ee232d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:15.258118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ffbf7-06ec-4b77-8f5e-bb170ee232d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:15.264050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ffbf7-06ec-4b77-8f5e-bb170ee232d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:15.264050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ffbf7-06ec-4b77-8f5e-bb170ee232d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:15.265456 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ffbf7-06ec-4b77-8f5e-bb170ee232d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:15.397054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ffbf7-06ec-4b77-8f5e-bb170ee232d0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:15.425171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1094/2195] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:15 2021] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:15.428536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ffbf7-06ec-4b77-8f5e-bb170ee232d0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:15.456297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ffbf7-06ec-4b77-8f5e-bb170ee232d0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:15.456714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac9a21-5e3a-462a-bca1-c03e16ee287d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:15.484136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a59d50-5c41-480b-8fc8-55df9c1ba76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:15.485735 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a59d50-5c41-480b-8fc8-55df9c1ba76f admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:15.487004 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a59d50-5c41-480b-8fc8-55df9c1ba76f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:15.487004 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a59d50-5c41-480b-8fc8-55df9c1ba76f admin admin] PATH_INFO: `/v3/projects/0ad9dda1f2f24eea97ddb10323f19115/users/314eb9a25df349459369fbe9c992c524/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:15.510350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac9a21-5e3a-462a-bca1-c03e16ee287d service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:15.529533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1102/2196] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:14 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:15.538174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a59d50-5c41-480b-8fc8-55df9c1ba76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad9dda1f2f24eea97ddb10323f19115, user_id=314eb9a25df349459369fbe9c992c524, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:15.572442 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a59d50-5c41-480b-8fc8-55df9c1ba76f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:15.596594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1095/2197] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:15 2021] PUT /identity/v3/projects/0ad9dda1f2f24eea97ddb10323f19115/users/314eb9a25df349459369fbe9c992c524/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:15.601442 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac9a21-5e3a-462a-bca1-c03e16ee287d service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:15.623832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac9a21-5e3a-462a-bca1-c03e16ee287d service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:15.744969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59249d6-92c2-4a8a-a7f0-7cee75fa9c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:15.745764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59249d6-92c2-4a8a-a7f0-7cee75fa9c14 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:15.746142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59249d6-92c2-4a8a-a7f0-7cee75fa9c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:15.746450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59249d6-92c2-4a8a-a7f0-7cee75fa9c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:15.747550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59249d6-92c2-4a8a-a7f0-7cee75fa9c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:15.784208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59249d6-92c2-4a8a-a7f0-7cee75fa9c14 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:15.798643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1103/2198] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:15 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:15.800276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a59d50-5c41-480b-8fc8-55df9c1ba76f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:15.811825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a59d50-5c41-480b-8fc8-55df9c1ba76f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:15.821910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a08c9-cdf5-4859-976f-e4edcdc9adce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:15.824178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a08c9-cdf5-4859-976f-e4edcdc9adce admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:15.825247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a08c9-cdf5-4859-976f-e4edcdc9adce admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:15.826060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a08c9-cdf5-4859-976f-e4edcdc9adce admin admin] PATH_INFO: `/v3/projects/0ad9dda1f2f24eea97ddb10323f19115/users/314eb9a25df349459369fbe9c992c524/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:15.829900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a08c9-cdf5-4859-976f-e4edcdc9adce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad9dda1f2f24eea97ddb10323f19115, user_id=314eb9a25df349459369fbe9c992c524, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:15.895231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a08c9-cdf5-4859-976f-e4edcdc9adce admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:15.920914 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1096/2199] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:15 2021] PUT /identity/v3/projects/0ad9dda1f2f24eea97ddb10323f19115/users/314eb9a25df349459369fbe9c992c524/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:15.927172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59249d6-92c2-4a8a-a7f0-7cee75fa9c14 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:15.962350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59249d6-92c2-4a8a-a7f0-7cee75fa9c14 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:16.165801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a67540-025c-4a1a-88d0-99aa7c5f3090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:16.165801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67540-025c-4a1a-88d0-99aa7c5f3090 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:16.165801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67540-025c-4a1a-88d0-99aa7c5f3090 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:16.165801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67540-025c-4a1a-88d0-99aa7c5f3090 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:16.167083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a67540-025c-4a1a-88d0-99aa7c5f3090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:16.264195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a67540-025c-4a1a-88d0-99aa7c5f3090 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:16.308006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a08c9-cdf5-4859-976f-e4edcdc9adce admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:16.308297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1104/2200] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:15 2021] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:16.328805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a08c9-cdf5-4859-976f-e4edcdc9adce admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:16.344228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8039c92-a1ec-4a00-a6c7-b882cea66089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:16.345302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8039c92-a1ec-4a00-a6c7-b882cea66089 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:16.345588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8039c92-a1ec-4a00-a6c7-b882cea66089 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:16.345876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8039c92-a1ec-4a00-a6c7-b882cea66089 admin admin] PATH_INFO: `/v3/projects/0ad9dda1f2f24eea97ddb10323f19115/users/314eb9a25df349459369fbe9c992c524/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:16.348583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8039c92-a1ec-4a00-a6c7-b882cea66089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad9dda1f2f24eea97ddb10323f19115, user_id=314eb9a25df349459369fbe9c992c524, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:16.398833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8039c92-a1ec-4a00-a6c7-b882cea66089 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:16.434777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1097/2201] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:16 2021] PUT /identity/v3/projects/0ad9dda1f2f24eea97ddb10323f19115/users/314eb9a25df349459369fbe9c992c524/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:16.439793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692d88-c258-4fdb-ae2a-cbf788068137 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:16.440150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692d88-c258-4fdb-ae2a-cbf788068137 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:16.440384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692d88-c258-4fdb-ae2a-cbf788068137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:16.473260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8039c92-a1ec-4a00-a6c7-b882cea66089 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:16.521604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-e3692d88-c258-4fdb-ae2a-cbf788068137 None None] MFA Rules not processed for user `314eb9a25df349459369fbe9c992c524`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:16.522831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e3692d88-c258-4fdb-ae2a-cbf788068137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:16.578024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8039c92-a1ec-4a00-a6c7-b882cea66089 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:16.583109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefa767-e834-4f21-be67-f07efa6ac4bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:16.585019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefa767-e834-4f21-be67-f07efa6ac4bb service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:16.585672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefa767-e834-4f21-be67-f07efa6ac4bb service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:16.586376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefa767-e834-4f21-be67-f07efa6ac4bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:16.589540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-feefa767-e834-4f21-be67-f07efa6ac4bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:16.667464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1105/2202] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:16 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:16.725664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefa767-e834-4f21-be67-f07efa6ac4bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:16.742952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692d88-c258-4fdb-ae2a-cbf788068137 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:16.745164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e3692d88-c258-4fdb-ae2a-cbf788068137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:16.761714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692d88-c258-4fdb-ae2a-cbf788068137 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:16.767138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366b77f-0c9e-4dcd-857d-c3673b259589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:16.768893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366b77f-0c9e-4dcd-857d-c3673b259589 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:16.769615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366b77f-0c9e-4dcd-857d-c3673b259589 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:16.770445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366b77f-0c9e-4dcd-857d-c3673b259589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:16.784662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefa767-e834-4f21-be67-f07efa6ac4bb service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:16.803014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1098/2203] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:16 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:16.873304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366b77f-0c9e-4dcd-857d-c3673b259589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:16.904765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366b77f-0c9e-4dcd-857d-c3673b259589 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:16.930464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1106/2204] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:16 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:18.022429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285dc9-b155-4542-a4e1-51f6bf41b91b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:18.023188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285dc9-b155-4542-a4e1-51f6bf41b91b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:18.023347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285dc9-b155-4542-a4e1-51f6bf41b91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:18.115562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-46285dc9-b155-4542-a4e1-51f6bf41b91b None None] MFA Rules not processed for user `f642c76a379d43fe97078fb43b7477dc`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:18.122023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-46285dc9-b155-4542-a4e1-51f6bf41b91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:18.264953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1099/2205] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:18 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:22.284646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366b77f-0c9e-4dcd-857d-c3673b259589 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:22.592528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366b77f-0c9e-4dcd-857d-c3673b259589 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:22.606387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:22.607818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.608370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.609409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] PATH_INFO: `/v3/users/1d9076505b054ddd93c5441542d6d342` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.614175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9076505b054ddd93c5441542d6d342)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:22.645072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:22.729312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9076505b054ddd93c5441542d6d342'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:22.740349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9076505b054ddd93c5441542d6d342'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:22.741804 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9076505b054ddd93c5441542d6d342'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:22.752399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9076505b054ddd93c5441542d6d342'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:22.779063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9076505b054ddd93c5441542d6d342'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:22.797633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1107/2206] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:22 2021] DELETE /identity/v3/users/1d9076505b054ddd93c5441542d6d342 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:22.799702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fe973-37d0-4c48-80b1-a196b80eb265 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:22.800514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fe973-37d0-4c48-80b1-a196b80eb265 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:22.800514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fe973-37d0-4c48-80b1-a196b80eb265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:22.826400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-809fe973-37d0-4c48-80b1-a196b80eb265 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:22.830232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-809fe973-37d0-4c48-80b1-a196b80eb265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:23.016842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1100/2207] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:23.045378 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:23.047982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:23.186693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e46be-db8b-4a5a-b585-6e557610c97a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:23.192243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8f3b-5236-4689-96ef-7a314ba976ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:23.193074 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8f3b-5236-4689-96ef-7a314ba976ab service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:23.193451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8f3b-5236-4689-96ef-7a314ba976ab service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:23.193844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8f3b-5236-4689-96ef-7a314ba976ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:23.208686 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8f3b-5236-4689-96ef-7a314ba976ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:23.239450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8f3b-5236-4689-96ef-7a314ba976ab service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:23.251941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1108/2208] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:24.465853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fe973-37d0-4c48-80b1-a196b80eb265 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.468745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-809fe973-37d0-4c48-80b1-a196b80eb265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:24.497733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fe973-37d0-4c48-80b1-a196b80eb265 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.506557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.508212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.509022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.509407 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] PATH_INFO: `/v3/projects/cc7e57b949ad4738b3fc88ab569f9be5` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.512399 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7e57b949ad4738b3fc88ab569f9be5)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:24.570514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:24.670467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7e57b949ad4738b3fc88ab569f9be5', 'request_id': 'req-ab1cd04e-c442-4530-87ed-62f3740c54cf'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.694373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7e57b949ad4738b3fc88ab569f9be5', 'request_id': 'req-ab1cd04e-c442-4530-87ed-62f3740c54cf'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.709367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7e57b949ad4738b3fc88ab569f9be5', 'request_id': 'req-ab1cd04e-c442-4530-87ed-62f3740c54cf'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.731121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] The token cache is being invalidate because project cc7e57b949ad4738b3fc88ab569f9be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:24.731799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.733370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:24.736571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1101/2209] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:24 2021] DELETE /identity/v3/projects/cc7e57b949ad4738b3fc88ab569f9be5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:24.741742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8f3b-5236-4689-96ef-7a314ba976ab service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:24.759368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8f3b-5236-4689-96ef-7a314ba976ab service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:24.890302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:24.891805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:24.892373 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:24.892950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] PATH_INFO: `/v3/users/314eb9a25df349459369fbe9c992c524` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:24.896164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314eb9a25df349459369fbe9c992c524)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:24.958646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:25.044732 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314eb9a25df349459369fbe9c992c524'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.056337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314eb9a25df349459369fbe9c992c524'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.057277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314eb9a25df349459369fbe9c992c524'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.083066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314eb9a25df349459369fbe9c992c524'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.105949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b3b10c12-0f77-44e3-a867-7d6fc1e01258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314eb9a25df349459369fbe9c992c524'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:25.129688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1109/2210] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:24 2021] DELETE /identity/v3/users/314eb9a25df349459369fbe9c992c524 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:26.007510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.009385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:26.024007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cd04e-c442-4530-87ed-62f3740c54cf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.103800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.104802 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.105182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.105649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] PATH_INFO: `/v3/projects/0ad9dda1f2f24eea97ddb10323f19115` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.107190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad9dda1f2f24eea97ddb10323f19115)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:26.137194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:26.203068 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad9dda1f2f24eea97ddb10323f19115', 'request_id': 'req-426517bf-614c-4f25-a1ee-9c1444881620'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.217302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad9dda1f2f24eea97ddb10323f19115', 'request_id': 'req-426517bf-614c-4f25-a1ee-9c1444881620'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.227376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad9dda1f2f24eea97ddb10323f19115', 'request_id': 'req-426517bf-614c-4f25-a1ee-9c1444881620'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.244679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] The token cache is being invalidate because project 0ad9dda1f2f24eea97ddb10323f19115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:26.245224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.246398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-426517bf-614c-4f25-a1ee-9c1444881620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:26.248933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1102/2211] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:26 2021] DELETE /identity/v3/projects/0ad9dda1f2f24eea97ddb10323f19115 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:26.258813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041d820-203c-4075-8f99-5df548937488 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.259644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041d820-203c-4075-8f99-5df548937488 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.259644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041d820-203c-4075-8f99-5df548937488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.379299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-1041d820-203c-4075-8f99-5df548937488 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:26.380461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1041d820-203c-4075-8f99-5df548937488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:26.476643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1110/2212] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:26.486817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445550bb-dfe5-4c99-9c61-cf12a1b485df None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.487298 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445550bb-dfe5-4c99-9c61-cf12a1b485df None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.487547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445550bb-dfe5-4c99-9c61-cf12a1b485df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.517261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-445550bb-dfe5-4c99-9c61-cf12a1b485df None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:26.519434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-445550bb-dfe5-4c99-9c61-cf12a1b485df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:26.532018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1103/2213] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:26.537811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041d820-203c-4075-8f99-5df548937488 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.554081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041d820-203c-4075-8f99-5df548937488 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.561007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd49ed-7540-478c-9362-4c74422f91a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.561768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd49ed-7540-478c-9362-4c74422f91a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.562190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd49ed-7540-478c-9362-4c74422f91a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.562577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd49ed-7540-478c-9362-4c74422f91a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.563397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd49ed-7540-478c-9362-4c74422f91a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:40:26.563863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd49ed-7540-478c-9362-4c74422f91a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:26.603207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd49ed-7540-478c-9362-4c74422f91a5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:26.619640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1111/2214] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:26.624899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445550bb-dfe5-4c99-9c61-cf12a1b485df None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.636737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445550bb-dfe5-4c99-9c61-cf12a1b485df None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.641910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d04a0-fe1b-4b1d-b97b-389f5b1d5f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.642734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d04a0-fe1b-4b1d-b97b-389f5b1d5f97 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.643224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d04a0-fe1b-4b1d-b97b-389f5b1d5f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.643515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d04a0-fe1b-4b1d-b97b-389f5b1d5f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.644205 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d04a0-fe1b-4b1d-b97b-389f5b1d5f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:26.671495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d04a0-fe1b-4b1d-b97b-389f5b1d5f97 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:26.707174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1104/2215] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:26 2021] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:26.713088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd49ed-7540-478c-9362-4c74422f91a5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.724659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd49ed-7540-478c-9362-4c74422f91a5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.802536 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0912d3-d2ce-4e4f-a07b-8109efd96b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.803247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0912d3-d2ce-4e4f-a07b-8109efd96b75 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.803628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0912d3-d2ce-4e4f-a07b-8109efd96b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.803957 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0912d3-d2ce-4e4f-a07b-8109efd96b75 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.804721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0912d3-d2ce-4e4f-a07b-8109efd96b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:26.832123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0912d3-d2ce-4e4f-a07b-8109efd96b75 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:26.857872 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1112/2216] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:26 2021] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:26.864902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d04a0-fe1b-4b1d-b97b-389f5b1d5f97 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.881131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d04a0-fe1b-4b1d-b97b-389f5b1d5f97 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.889388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17351-c524-4ea5-acdf-dc33a943ae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.891426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17351-c524-4ea5-acdf-dc33a943ae69 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.892218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17351-c524-4ea5-acdf-dc33a943ae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.892767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17351-c524-4ea5-acdf-dc33a943ae69 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.894383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c17351-c524-4ea5-acdf-dc33a943ae69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:26.925479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c17351-c524-4ea5-acdf-dc33a943ae69 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:26.939271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1105/2217] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:26 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:26.946594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0912d3-d2ce-4e4f-a07b-8109efd96b75 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:26.961252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0912d3-d2ce-4e4f-a07b-8109efd96b75 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:26.965871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca6b6c-661b-4708-8e1e-4be5ebb827c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:26.966797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca6b6c-661b-4708-8e1e-4be5ebb827c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:26.967081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca6b6c-661b-4708-8e1e-4be5ebb827c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:26.967369 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca6b6c-661b-4708-8e1e-4be5ebb827c3 admin admin] PATH_INFO: `/v3/projects/d03993486f6f4ff6bfcccab2c2e3b72a/users/54784adec17748f8ae9a221f21cf8428/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:26.994254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca6b6c-661b-4708-8e1e-4be5ebb827c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d03993486f6f4ff6bfcccab2c2e3b72a, user_id=54784adec17748f8ae9a221f21cf8428, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:27.024170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca6b6c-661b-4708-8e1e-4be5ebb827c3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.042458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1113/2218] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:26 2021] PUT /identity/v3/projects/d03993486f6f4ff6bfcccab2c2e3b72a/users/54784adec17748f8ae9a221f21cf8428/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:27.055676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76f990-af10-445b-a277-b56edcd8c33e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.056705 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76f990-af10-445b-a277-b56edcd8c33e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.057039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76f990-af10-445b-a277-b56edcd8c33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.098877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0e76f990-af10-445b-a277-b56edcd8c33e None None] MFA Rules not processed for user `54784adec17748f8ae9a221f21cf8428`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:27.100557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0e76f990-af10-445b-a277-b56edcd8c33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.192860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1106/2219] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:27 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:27.204073 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca6b6c-661b-4708-8e1e-4be5ebb827c3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.207645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8dca6b6c-661b-4708-8e1e-4be5ebb827c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.324952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca6b6c-661b-4708-8e1e-4be5ebb827c3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:27.328700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a94ef5-9750-4205-8000-e0163be929c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:27.329358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94ef5-9750-4205-8000-e0163be929c4 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:27.329643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94ef5-9750-4205-8000-e0163be929c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:27.330128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94ef5-9750-4205-8000-e0163be929c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:27.340912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a94ef5-9750-4205-8000-e0163be929c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:27.370204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a94ef5-9750-4205-8000-e0163be929c4 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:27.385307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1114/2220] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:27 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:27.787741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76f990-af10-445b-a277-b56edcd8c33e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:27.790599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0e76f990-af10-445b-a277-b56edcd8c33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:27.984880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76f990-af10-445b-a277-b56edcd8c33e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.003575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.006095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.007731 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.008995 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] PATH_INFO: `/v3/users/fb81c28d208842c0a67bfff35b1b54f3` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.012359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb81c28d208842c0a67bfff35b1b54f3)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:28.069637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.243981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb81c28d208842c0a67bfff35b1b54f3'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:28.301725 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb81c28d208842c0a67bfff35b1b54f3'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:28.345193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb81c28d208842c0a67bfff35b1b54f3'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:28.350533 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb81c28d208842c0a67bfff35b1b54f3'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:28.386870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb81c28d208842c0a67bfff35b1b54f3'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:28.439139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1107/2221] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:27 2021] DELETE /identity/v3/users/fb81c28d208842c0a67bfff35b1b54f3 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:28.440418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23648691-ada7-47a0-9d0e-7fb0c3cd9bc9 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.441115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23648691-ada7-47a0-9d0e-7fb0c3cd9bc9 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.441115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23648691-ada7-47a0-9d0e-7fb0c3cd9bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.511586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-23648691-ada7-47a0-9d0e-7fb0c3cd9bc9 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:28.513392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-23648691-ada7-47a0-9d0e-7fb0c3cd9bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:28.693303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1115/2222] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:28.705028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:28.714894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:28.854443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072373-0c63-4c5f-90e5-5553dba9dccf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:28.858822 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a199f-5b52-4b44-98e8-4860165fd6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:28.859645 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a199f-5b52-4b44-98e8-4860165fd6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:28.860150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a199f-5b52-4b44-98e8-4860165fd6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:28.860583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a199f-5b52-4b44-98e8-4860165fd6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:28.878461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a199f-5b52-4b44-98e8-4860165fd6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:28.933814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a199f-5b52-4b44-98e8-4860165fd6b5 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:28.953933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1108/2223] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:30.533900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23648691-ada7-47a0-9d0e-7fb0c3cd9bc9 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:30.536468 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-23648691-ada7-47a0-9d0e-7fb0c3cd9bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:30.589195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23648691-ada7-47a0-9d0e-7fb0c3cd9bc9 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:30.627927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:30.629405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.629916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.631377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] PATH_INFO: `/v3/projects/e7c08362bb0b488db1a1b7562e6e1451` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.633571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c08362bb0b488db1a1b7562e6e1451)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:30.695772 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:30.764278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c08362bb0b488db1a1b7562e6e1451', 'request_id': 'req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.789645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c08362bb0b488db1a1b7562e6e1451', 'request_id': 'req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.801414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c08362bb0b488db1a1b7562e6e1451', 'request_id': 'req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.819011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] The token cache is being invalidate because project e7c08362bb0b488db1a1b7562e6e1451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:30.819376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.820423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:30.825281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1116/2224] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:30 2021] DELETE /identity/v3/projects/e7c08362bb0b488db1a1b7562e6e1451 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:30.827637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a199f-5b52-4b44-98e8-4860165fd6b5 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:30.844562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a199f-5b52-4b44-98e8-4860165fd6b5 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:30.951216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:30.952622 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:30.953121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:30.953610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] PATH_INFO: `/v3/users/8372c82512674176949b418754d49cec` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:30.957512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8372c82512674176949b418754d49cec)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:31.048303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:31.178529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8372c82512674176949b418754d49cec'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.212494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8372c82512674176949b418754d49cec'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.232264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8372c82512674176949b418754d49cec'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.233413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8372c82512674176949b418754d49cec'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.246292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8987cc12-b15c-4461-9d83-2184a91b8d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8372c82512674176949b418754d49cec'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:31.257230 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1109/2225] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:30 2021] DELETE /identity/v3/users/8372c82512674176949b418754d49cec => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:31.776873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:31.779541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:31.804483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced78d7-d4ce-4ac1-82bc-5d1b2c904ae4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:31.928935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:31.929857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:31.930270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:31.930699 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] PATH_INFO: `/v3/projects/b1663f4005664eb284d72b1a6f5e9d1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:31.932260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1663f4005664eb284d72b1a6f5e9d1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:31.968039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.056992 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1663f4005664eb284d72b1a6f5e9d1d', 'request_id': 'req-48096d63-1a03-4d07-839d-d2cf3bfb2098'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.072867 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1663f4005664eb284d72b1a6f5e9d1d', 'request_id': 'req-48096d63-1a03-4d07-839d-d2cf3bfb2098'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.084760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1663f4005664eb284d72b1a6f5e9d1d', 'request_id': 'req-48096d63-1a03-4d07-839d-d2cf3bfb2098'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.103827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] The token cache is being invalidate because project b1663f4005664eb284d72b1a6f5e9d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:32.104317 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.108301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-48096d63-1a03-4d07-839d-d2cf3bfb2098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:32.122515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1117/2226] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:31 2021] DELETE /identity/v3/projects/b1663f4005664eb284d72b1a6f5e9d1d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:32.125091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c13b-1d27-4893-a864-e92190c84ccb None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.125944 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c13b-1d27-4893-a864-e92190c84ccb None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.126153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39c13b-1d27-4893-a864-e92190c84ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.205540 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-3f39c13b-1d27-4893-a864-e92190c84ccb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:32.207880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3f39c13b-1d27-4893-a864-e92190c84ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.433502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1110/2227] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:32.449510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ca515-6721-49cc-879e-06f69fb68a67 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.449839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ca515-6721-49cc-879e-06f69fb68a67 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.450405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ca515-6721-49cc-879e-06f69fb68a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.553313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-8c7ca515-6721-49cc-879e-06f69fb68a67 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:32.557026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8c7ca515-6721-49cc-879e-06f69fb68a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:32.587501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1118/2228] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:32.593562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39c13b-1d27-4893-a864-e92190c84ccb None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.633317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39c13b-1d27-4893-a864-e92190c84ccb None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.645555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7725-b8ee-4fd2-a395-56e0a1dd3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.646679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7725-b8ee-4fd2-a395-56e0a1dd3ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.647627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7725-b8ee-4fd2-a395-56e0a1dd3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.647864 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7725-b8ee-4fd2-a395-56e0a1dd3ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.649145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c7725-b8ee-4fd2-a395-56e0a1dd3ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:40:32.649680 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c7725-b8ee-4fd2-a395-56e0a1dd3ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:32.713467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c7725-b8ee-4fd2-a395-56e0a1dd3ee1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.755105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1111/2229] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:32.759460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ca515-6721-49cc-879e-06f69fb68a67 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.789690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ca515-6721-49cc-879e-06f69fb68a67 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:32.801839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad783a-680f-48f6-a3ac-10f86d1cfedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:32.801839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad783a-680f-48f6-a3ac-10f86d1cfedb admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:32.801839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad783a-680f-48f6-a3ac-10f86d1cfedb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:32.801839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad783a-680f-48f6-a3ac-10f86d1cfedb admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:32.802763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad783a-680f-48f6-a3ac-10f86d1cfedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:32.873878 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad783a-680f-48f6-a3ac-10f86d1cfedb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:32.925883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1119/2230] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:32 2021] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:32.930341 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7725-b8ee-4fd2-a395-56e0a1dd3ee1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:32.942537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7725-b8ee-4fd2-a395-56e0a1dd3ee1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.037473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e104c9-47f5-411f-8428-cacfd48a7d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.038373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e104c9-47f5-411f-8428-cacfd48a7d86 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.038885 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e104c9-47f5-411f-8428-cacfd48a7d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.039482 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e104c9-47f5-411f-8428-cacfd48a7d86 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.040785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e104c9-47f5-411f-8428-cacfd48a7d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:33.099315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e104c9-47f5-411f-8428-cacfd48a7d86 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.149626 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1112/2231] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:32 2021] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:33.153222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad783a-680f-48f6-a3ac-10f86d1cfedb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:33.193806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad783a-680f-48f6-a3ac-10f86d1cfedb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.203679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa07c-c21e-42c7-b0b7-f3a0a63dc6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.205319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa07c-c21e-42c7-b0b7-f3a0a63dc6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.207154 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa07c-c21e-42c7-b0b7-f3a0a63dc6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.208601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa07c-c21e-42c7-b0b7-f3a0a63dc6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.210880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaa07c-c21e-42c7-b0b7-f3a0a63dc6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:33.269268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaa07c-c21e-42c7-b0b7-f3a0a63dc6a3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.292768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1120/2232] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:33.297665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e104c9-47f5-411f-8428-cacfd48a7d86 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:33.313038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e104c9-47f5-411f-8428-cacfd48a7d86 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.321214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e10320-9bf6-426b-b546-73e8cd263b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.322265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e10320-9bf6-426b-b546-73e8cd263b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.323202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e10320-9bf6-426b-b546-73e8cd263b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.323573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e10320-9bf6-426b-b546-73e8cd263b33 admin admin] PATH_INFO: `/v3/projects/629575a565f4457b9d274df481e66f1b/users/0a0afab913f64396a966154c871e3529/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.350050 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e10320-9bf6-426b-b546-73e8cd263b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629575a565f4457b9d274df481e66f1b, user_id=0a0afab913f64396a966154c871e3529, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:33.378866 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e10320-9bf6-426b-b546-73e8cd263b33 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.408634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1113/2233] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:33 2021] PUT /identity/v3/projects/629575a565f4457b9d274df481e66f1b/users/0a0afab913f64396a966154c871e3529/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:33.432052 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd619-519a-4acc-a160-1fdb3346cb3f None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.433356 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd619-519a-4acc-a160-1fdb3346cb3f None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.433912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd619-519a-4acc-a160-1fdb3346cb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.516081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-5a4dd619-519a-4acc-a160-1fdb3346cb3f None None] MFA Rules not processed for user `0a0afab913f64396a966154c871e3529`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:33.519070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5a4dd619-519a-4acc-a160-1fdb3346cb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:33.654896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1121/2234] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:33 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:33.667481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e10320-9bf6-426b-b546-73e8cd263b33 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:33.669981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e3e10320-9bf6-426b-b546-73e8cd263b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:33.788634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e10320-9bf6-426b-b546-73e8cd263b33 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:33.794582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f211545-a257-49b7-ac34-6104d15e6dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:33.795513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f211545-a257-49b7-ac34-6104d15e6dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:33.796027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f211545-a257-49b7-ac34-6104d15e6dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:33.796374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f211545-a257-49b7-ac34-6104d15e6dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:33.823714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f211545-a257-49b7-ac34-6104d15e6dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:33.888395 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f211545-a257-49b7-ac34-6104d15e6dc2 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:33.908526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1114/2235] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:33 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:34.782808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd619-519a-4acc-a160-1fdb3346cb3f None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:34.786406 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5a4dd619-519a-4acc-a160-1fdb3346cb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:34.960873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd619-519a-4acc-a160-1fdb3346cb3f None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:34.970307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:34.972659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:34.973667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:34.974140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] PATH_INFO: `/v3/users/f439bb613e6a4e38a6c0669fe7394d8f` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:34.975862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f439bb613e6a4e38a6c0669fe7394d8f)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:35.032055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.148260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f439bb613e6a4e38a6c0669fe7394d8f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.167579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f439bb613e6a4e38a6c0669fe7394d8f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.168906 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f439bb613e6a4e38a6c0669fe7394d8f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.184267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f439bb613e6a4e38a6c0669fe7394d8f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.217206 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f439bb613e6a4e38a6c0669fe7394d8f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:35.232154 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1122/2236] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:34 2021] DELETE /identity/v3/users/f439bb613e6a4e38a6c0669fe7394d8f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:35.240240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35ea0-73e6-415d-b5b5-65e510e86344 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.241065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35ea0-73e6-415d-b5b5-65e510e86344 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.241340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35ea0-73e6-415d-b5b5-65e510e86344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.279860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b1f35ea0-73e6-415d-b5b5-65e510e86344 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:35.281172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b1f35ea0-73e6-415d-b5b5-65e510e86344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.409351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1115/2237] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:35.473353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:35.477499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:35.574976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d3f64-fe77-4506-b414-7790c1eaccea admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:35.583915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c7bc-53c5-4872-b86a-b20fb9393c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:35.585892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c7bc-53c5-4872-b86a-b20fb9393c2c service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:35.587805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c7bc-53c5-4872-b86a-b20fb9393c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:35.588562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c7bc-53c5-4872-b86a-b20fb9393c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:35.609911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c7bc-53c5-4872-b86a-b20fb9393c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:35.690417 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c7bc-53c5-4872-b86a-b20fb9393c2c service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:35.718636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1123/2238] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:37.048387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35ea0-73e6-415d-b5b5-65e510e86344 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.051399 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b1f35ea0-73e6-415d-b5b5-65e510e86344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:37.075826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35ea0-73e6-415d-b5b5-65e510e86344 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.091992 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.093481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.095187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.095187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] PATH_INFO: `/v3/projects/27465ba1e8a64aeb8e34d281dadbebd7` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.103446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27465ba1e8a64aeb8e34d281dadbebd7)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:37.196383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.336616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27465ba1e8a64aeb8e34d281dadbebd7', 'request_id': 'req-990bd65b-25ff-4035-b19e-1d878b61e89f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:37.358620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27465ba1e8a64aeb8e34d281dadbebd7', 'request_id': 'req-990bd65b-25ff-4035-b19e-1d878b61e89f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:37.372132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27465ba1e8a64aeb8e34d281dadbebd7', 'request_id': 'req-990bd65b-25ff-4035-b19e-1d878b61e89f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:37.387773 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] The token cache is being invalidate because project 27465ba1e8a64aeb8e34d281dadbebd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:37.388099 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:37.388982 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-990bd65b-25ff-4035-b19e-1d878b61e89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:37.390587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1116/2239] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:37 2021] DELETE /identity/v3/projects/27465ba1e8a64aeb8e34d281dadbebd7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:37.399871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9355e-a542-4f99-ab07-9ffdc2bf61d0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.400749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9355e-a542-4f99-ab07-9ffdc2bf61d0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.400940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9355e-a542-4f99-ab07-9ffdc2bf61d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.447845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4de9355e-a542-4f99-ab07-9ffdc2bf61d0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:37.450220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4de9355e-a542-4f99-ab07-9ffdc2bf61d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:37.585515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1124/2240] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:37.594292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fc771-2e72-4272-bdb8-851c9f83f1ce None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.594589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fc771-2e72-4272-bdb8-851c9f83f1ce None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.594828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fc771-2e72-4272-bdb8-851c9f83f1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.624517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-940fc771-2e72-4272-bdb8-851c9f83f1ce None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:37.626013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-940fc771-2e72-4272-bdb8-851c9f83f1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:37.639190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1117/2241] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:37.645255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9355e-a542-4f99-ab07-9ffdc2bf61d0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.660349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9355e-a542-4f99-ab07-9ffdc2bf61d0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.667079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ff3d2-f761-4593-8442-24720381b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.668173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ff3d2-f761-4593-8442-24720381b9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.668738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ff3d2-f761-4593-8442-24720381b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.669196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ff3d2-f761-4593-8442-24720381b9c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.670941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ff3d2-f761-4593-8442-24720381b9c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:40:37.671499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ff3d2-f761-4593-8442-24720381b9c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:37.732980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ff3d2-f761-4593-8442-24720381b9c1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.755139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1125/2242] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:40:37.761333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fc771-2e72-4272-bdb8-851c9f83f1ce None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.778995 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fc771-2e72-4272-bdb8-851c9f83f1ce None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:37.786201 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ab62c-307f-4adc-aab2-38d105f1317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:37.787165 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ab62c-307f-4adc-aab2-38d105f1317d admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:37.787915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ab62c-307f-4adc-aab2-38d105f1317d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:37.788065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ab62c-307f-4adc-aab2-38d105f1317d admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:37.789042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ab62c-307f-4adc-aab2-38d105f1317d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:37.817479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ab62c-307f-4adc-aab2-38d105f1317d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:37.860879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1118/2243] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:37 2021] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:37.865688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ff3d2-f761-4593-8442-24720381b9c1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:37.885521 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ff3d2-f761-4593-8442-24720381b9c1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.007046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4cb95-5003-4a43-a9e1-2fb6e2d8f3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.008118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4cb95-5003-4a43-a9e1-2fb6e2d8f3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.008701 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4cb95-5003-4a43-a9e1-2fb6e2d8f3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.009290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4cb95-5003-4a43-a9e1-2fb6e2d8f3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.010334 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4cb95-5003-4a43-a9e1-2fb6e2d8f3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:38.041212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4cb95-5003-4a43-a9e1-2fb6e2d8f3b4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.081266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1126/2244] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:37 2021] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:38.083857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ab62c-307f-4adc-aab2-38d105f1317d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:38.106905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ab62c-307f-4adc-aab2-38d105f1317d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.117739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79848d00-c4a8-48fb-9b43-58ddd0ea562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.120167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848d00-c4a8-48fb-9b43-58ddd0ea562c admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.121103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848d00-c4a8-48fb-9b43-58ddd0ea562c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.121867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848d00-c4a8-48fb-9b43-58ddd0ea562c admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.124214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79848d00-c4a8-48fb-9b43-58ddd0ea562c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:38.166842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79848d00-c4a8-48fb-9b43-58ddd0ea562c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.186725 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4cb95-5003-4a43-a9e1-2fb6e2d8f3b4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:38.187464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1119/2245] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:38 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:38.203695 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4cb95-5003-4a43-a9e1-2fb6e2d8f3b4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.217625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1dd1d-21ee-4a82-ac91-9e51d6190adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.218691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1dd1d-21ee-4a82-ac91-9e51d6190adb admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.218926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1dd1d-21ee-4a82-ac91-9e51d6190adb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.219218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1dd1d-21ee-4a82-ac91-9e51d6190adb admin admin] PATH_INFO: `/v3/projects/9a687d83941a46d8893bb58f302b2951/users/60acaee6050143099c2ded8515eab3d3/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.248605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1dd1d-21ee-4a82-ac91-9e51d6190adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a687d83941a46d8893bb58f302b2951, user_id=60acaee6050143099c2ded8515eab3d3, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:38.282675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1dd1d-21ee-4a82-ac91-9e51d6190adb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.308947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1127/2246] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:38 2021] PUT /identity/v3/projects/9a687d83941a46d8893bb58f302b2951/users/60acaee6050143099c2ded8515eab3d3/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:38.317014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb23f7-c88e-482f-a68f-b4e53a05dd40 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.317358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb23f7-c88e-482f-a68f-b4e53a05dd40 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.317616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb23f7-c88e-482f-a68f-b4e53a05dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.370876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-41eb23f7-c88e-482f-a68f-b4e53a05dd40 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:38.372667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-41eb23f7-c88e-482f-a68f-b4e53a05dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:38.519168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1120/2247] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:40:38.541321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1dd1d-21ee-4a82-ac91-9e51d6190adb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:38.543093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cfd1dd1d-21ee-4a82-ac91-9e51d6190adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:38.759837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1dd1d-21ee-4a82-ac91-9e51d6190adb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:38.776606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486dc28-869d-4c5d-b4c4-621f7eaf73e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:38.777547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486dc28-869d-4c5d-b4c4-621f7eaf73e8 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:38.778045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486dc28-869d-4c5d-b4c4-621f7eaf73e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:38.778506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486dc28-869d-4c5d-b4c4-621f7eaf73e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:38.822418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486dc28-869d-4c5d-b4c4-621f7eaf73e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:38.897285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486dc28-869d-4c5d-b4c4-621f7eaf73e8 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:38.913325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1128/2248] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:47.702657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2485dc6-b463-4829-a39f-4d9516e6fbdc None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:47.703900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2485dc6-b463-4829-a39f-4d9516e6fbdc None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:47.704354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2485dc6-b463-4829-a39f-4d9516e6fbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:47.754460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a2485dc6-b463-4829-a39f-4d9516e6fbdc None None] MFA Rules not processed for user `60acaee6050143099c2ded8515eab3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:47.756063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a2485dc6-b463-4829-a39f-4d9516e6fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:47.872857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1121/2249] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:47 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:47.874110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486dc28-869d-4c5d-b4c4-621f7eaf73e8 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:47.891501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486dc28-869d-4c5d-b4c4-621f7eaf73e8 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:47.900609 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64835186-f085-4091-b0e7-f1f60c6826f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:47.908157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64835186-f085-4091-b0e7-f1f60c6826f3 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:47.908955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64835186-f085-4091-b0e7-f1f60c6826f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:47.909529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64835186-f085-4091-b0e7-f1f60c6826f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:47.910996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64835186-f085-4091-b0e7-f1f60c6826f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:47.976049 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64835186-f085-4091-b0e7-f1f60c6826f3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:48.028452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1129/2250] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:47 2021] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:48.033457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2485dc6-b463-4829-a39f-4d9516e6fbdc None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:48.055346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2485dc6-b463-4829-a39f-4d9516e6fbdc None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:48.296446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d71d0-8a68-4525-a8e0-a55a3229f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:48.297543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d71d0-8a68-4525-a8e0-a55a3229f298 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:48.298018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d71d0-8a68-4525-a8e0-a55a3229f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:48.298443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d71d0-8a68-4525-a8e0-a55a3229f298 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:48.299446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d71d0-8a68-4525-a8e0-a55a3229f298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:48.326344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d71d0-8a68-4525-a8e0-a55a3229f298 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:48.371027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1122/2251] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:48 2021] POST /identity/v3/users => generated 292 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:48.376395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64835186-f085-4091-b0e7-f1f60c6826f3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:48.427817 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64835186-f085-4091-b0e7-f1f60c6826f3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:48.454934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1142c-d3c9-4b92-a939-26484132fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:48.456350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1142c-d3c9-4b92-a939-26484132fd8b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:48.456618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1142c-d3c9-4b92-a939-26484132fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:48.457160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1142c-d3c9-4b92-a939-26484132fd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:48.469616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1142c-d3c9-4b92-a939-26484132fd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:48.541398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1142c-d3c9-4b92-a939-26484132fd8b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:48.566821 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1130/2252] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:48 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:48.571038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d71d0-8a68-4525-a8e0-a55a3229f298 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:48.610542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d71d0-8a68-4525-a8e0-a55a3229f298 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:48.626726 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb387129-45ee-4173-bc81-f492a39d8882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:48.627634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb387129-45ee-4173-bc81-f492a39d8882 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:48.627994 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb387129-45ee-4173-bc81-f492a39d8882 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:48.628287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb387129-45ee-4173-bc81-f492a39d8882 admin admin] PATH_INFO: `/v3/projects/bb99884353fe4454bb8d173478d35434/users/6277cfcd4a084454ab52b5efd15c2dcb/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:48.712849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb387129-45ee-4173-bc81-f492a39d8882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb99884353fe4454bb8d173478d35434, user_id=6277cfcd4a084454ab52b5efd15c2dcb, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:48.826223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb387129-45ee-4173-bc81-f492a39d8882 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:48.869948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1123/2253] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:48 2021] PUT /identity/v3/projects/bb99884353fe4454bb8d173478d35434/users/6277cfcd4a084454ab52b5efd15c2dcb/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:48.876583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1142c-d3c9-4b92-a939-26484132fd8b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:48.899923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1142c-d3c9-4b92-a939-26484132fd8b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:49.046183 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba886bd-4dcf-462d-8245-920d947b0c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:49.046989 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba886bd-4dcf-462d-8245-920d947b0c56 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:49.047522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba886bd-4dcf-462d-8245-920d947b0c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:49.048201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba886bd-4dcf-462d-8245-920d947b0c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:49.049479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba886bd-4dcf-462d-8245-920d947b0c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:49.107418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba886bd-4dcf-462d-8245-920d947b0c56 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:49.135367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1131/2254] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:48 2021] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:49.138731 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb387129-45ee-4173-bc81-f492a39d8882 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:49.163464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb387129-45ee-4173-bc81-f492a39d8882 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:49.172739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324bc6-62ec-48ee-8d6d-7eebb7d0aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:49.174662 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324bc6-62ec-48ee-8d6d-7eebb7d0aacc admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:49.176070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324bc6-62ec-48ee-8d6d-7eebb7d0aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:49.176070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324bc6-62ec-48ee-8d6d-7eebb7d0aacc admin admin] PATH_INFO: `/v3/projects/bb99884353fe4454bb8d173478d35434/users/6277cfcd4a084454ab52b5efd15c2dcb/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:49.180159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b324bc6-62ec-48ee-8d6d-7eebb7d0aacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb99884353fe4454bb8d173478d35434, user_id=6277cfcd4a084454ab52b5efd15c2dcb, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:49.258521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b324bc6-62ec-48ee-8d6d-7eebb7d0aacc admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:49.275194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1124/2255] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:49 2021] PUT /identity/v3/projects/bb99884353fe4454bb8d173478d35434/users/6277cfcd4a084454ab52b5efd15c2dcb/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:49.279901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba886bd-4dcf-462d-8245-920d947b0c56 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:49.291269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba886bd-4dcf-462d-8245-920d947b0c56 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:49.338875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324bc6-62ec-48ee-8d6d-7eebb7d0aacc admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:49.342381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5b324bc6-62ec-48ee-8d6d-7eebb7d0aacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:49.445746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a27683-287e-432b-b983-9a1ed1dae33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:49.446672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a27683-287e-432b-b983-9a1ed1dae33a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:49.446978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a27683-287e-432b-b983-9a1ed1dae33a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:49.447268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a27683-287e-432b-b983-9a1ed1dae33a admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:49.449653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a27683-287e-432b-b983-9a1ed1dae33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:49.520201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a27683-287e-432b-b983-9a1ed1dae33a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:49.544681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1132/2256] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:49 2021] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:49.545676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a27683-287e-432b-b983-9a1ed1dae33a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:49.556767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a27683-287e-432b-b983-9a1ed1dae33a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:49.563929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05428f90-61d2-4228-abb4-d20d3c20ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:49.564778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05428f90-61d2-4228-abb4-d20d3c20ac99 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:49.565063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05428f90-61d2-4228-abb4-d20d3c20ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:49.565351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05428f90-61d2-4228-abb4-d20d3c20ac99 admin admin] PATH_INFO: `/v3/projects/bb99884353fe4454bb8d173478d35434/users/6277cfcd4a084454ab52b5efd15c2dcb/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:49.567560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05428f90-61d2-4228-abb4-d20d3c20ac99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb99884353fe4454bb8d173478d35434, user_id=6277cfcd4a084454ab52b5efd15c2dcb, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:49.599186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05428f90-61d2-4228-abb4-d20d3c20ac99 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:49.627762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1133/2257] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:49 2021] PUT /identity/v3/projects/bb99884353fe4454bb8d173478d35434/users/6277cfcd4a084454ab52b5efd15c2dcb/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:49.684182 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324bc6-62ec-48ee-8d6d-7eebb7d0aacc admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:49.855632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c4ce-9402-481b-ac55-7d2ed3d31fca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:49.856580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c4ce-9402-481b-ac55-7d2ed3d31fca service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:49.857366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c4ce-9402-481b-ac55-7d2ed3d31fca service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:49.858128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c4ce-9402-481b-ac55-7d2ed3d31fca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:49.865729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-55c5c4ce-9402-481b-ac55-7d2ed3d31fca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:49.897566 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c4ce-9402-481b-ac55-7d2ed3d31fca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:49.988745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c4ce-9402-481b-ac55-7d2ed3d31fca service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:50.018472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1125/2258] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:49 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:40:50.097188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05428f90-61d2-4228-abb4-d20d3c20ac99 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:50.102740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-05428f90-61d2-4228-abb4-d20d3c20ac99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:50.357785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05428f90-61d2-4228-abb4-d20d3c20ac99 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:50.372600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:50.373454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:50.373885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:50.375699 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] PATH_INFO: `/v3/users/0a0afab913f64396a966154c871e3529` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:50.376597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0afab913f64396a966154c871e3529)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:50.440583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:50.580722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0afab913f64396a966154c871e3529'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.606916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0afab913f64396a966154c871e3529'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.611306 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0afab913f64396a966154c871e3529'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.626067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0afab913f64396a966154c871e3529'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.648620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0afab913f64396a966154c871e3529'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:50.662801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1134/2259] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:40:50 2021] DELETE /identity/v3/users/0a0afab913f64396a966154c871e3529 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:50.665286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9904b9-6bcc-400b-ab8f-8727d2771213 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:50.665588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9904b9-6bcc-400b-ab8f-8727d2771213 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:50.665744 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9904b9-6bcc-400b-ab8f-8727d2771213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:50.709686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0d9904b9-6bcc-400b-ab8f-8727d2771213 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:50.713503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0d9904b9-6bcc-400b-ab8f-8727d2771213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:50.866977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1126/2260] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:50.879783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:50.881185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:51.059288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9059ff-b25d-4cbb-aa19-bc42c7637ace admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:51.064263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcfaf3-cfcc-434c-ac17-c6b8878ad377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:51.065226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcfaf3-cfcc-434c-ac17-c6b8878ad377 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:51.065778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcfaf3-cfcc-434c-ac17-c6b8878ad377 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:51.066380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcfaf3-cfcc-434c-ac17-c6b8878ad377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:51.081927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcfaf3-cfcc-434c-ac17-c6b8878ad377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:51.119171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcfaf3-cfcc-434c-ac17-c6b8878ad377 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:51.137474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1135/2261] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:40:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:40:52.388980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9904b9-6bcc-400b-ab8f-8727d2771213 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:52.392990 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0d9904b9-6bcc-400b-ab8f-8727d2771213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:52.426975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9904b9-6bcc-400b-ab8f-8727d2771213 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:52.436833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:52.440855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:52.443481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:52.446303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] PATH_INFO: `/v3/projects/629575a565f4457b9d274df481e66f1b` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:52.450775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629575a565f4457b9d274df481e66f1b)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:52.534917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:52.697454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629575a565f4457b9d274df481e66f1b', 'request_id': 'req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:52.724440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629575a565f4457b9d274df481e66f1b', 'request_id': 'req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:52.744809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629575a565f4457b9d274df481e66f1b', 'request_id': 'req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:52.775159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] The token cache is being invalidate because project 629575a565f4457b9d274df481e66f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:40:52.776567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:52.777835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-82bf75d7-83d7-4d08-8ef8-b1e5e96620b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:40:52.780569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1127/2262] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:40:52 2021] DELETE /identity/v3/projects/629575a565f4457b9d274df481e66f1b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:52.790727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b8e55-9e27-49bb-9873-6823555ac54b None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:52.794039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b8e55-9e27-49bb-9873-6823555ac54b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:52.794634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b8e55-9e27-49bb-9873-6823555ac54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:52.908149 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-fc6b8e55-9e27-49bb-9873-6823555ac54b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:52.910427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-fc6b8e55-9e27-49bb-9873-6823555ac54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:53.113129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1136/2263] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:53.117053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31faf00-e972-4479-9245-fece4b4e40a4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:53.118571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31faf00-e972-4479-9245-fece4b4e40a4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:53.119015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31faf00-e972-4479-9245-fece4b4e40a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:53.145857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a31faf00-e972-4479-9245-fece4b4e40a4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:53.148392 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a31faf00-e972-4479-9245-fece4b4e40a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:53.164334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1128/2264] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:53.165242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b8e55-9e27-49bb-9873-6823555ac54b None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:53.177407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b8e55-9e27-49bb-9873-6823555ac54b None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:53.191567 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37892ed6-661b-4772-9885-19420c5a7bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:53.203195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37892ed6-661b-4772-9885-19420c5a7bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:53.204102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37892ed6-661b-4772-9885-19420c5a7bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:53.208896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37892ed6-661b-4772-9885-19420c5a7bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:53.210057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37892ed6-661b-4772-9885-19420c5a7bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:40:53.210606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37892ed6-661b-4772-9885-19420c5a7bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:53.269092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37892ed6-661b-4772-9885-19420c5a7bc9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:53.288597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1137/2265] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:40:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:40:53.295115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31faf00-e972-4479-9245-fece4b4e40a4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:53.313517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31faf00-e972-4479-9245-fece4b4e40a4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:53.318868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fda1d-6d30-4601-9527-331ff8de9dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:53.319546 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fda1d-6d30-4601-9527-331ff8de9dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:53.319839 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fda1d-6d30-4601-9527-331ff8de9dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:53.320116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fda1d-6d30-4601-9527-331ff8de9dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:53.320790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fda1d-6d30-4601-9527-331ff8de9dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:53.376311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fda1d-6d30-4601-9527-331ff8de9dd2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:53.464875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1129/2266] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:53 2021] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:53.469935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37892ed6-661b-4772-9885-19420c5a7bc9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:53.514370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37892ed6-661b-4772-9885-19420c5a7bc9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:53.771965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8fc3d-eb32-45ef-8b8f-97fcd8342236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:53.773362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8fc3d-eb32-45ef-8b8f-97fcd8342236 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:53.773767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8fc3d-eb32-45ef-8b8f-97fcd8342236 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:53.774151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8fc3d-eb32-45ef-8b8f-97fcd8342236 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:53.775195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8fc3d-eb32-45ef-8b8f-97fcd8342236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:53.843006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8fc3d-eb32-45ef-8b8f-97fcd8342236 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:53.892262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1138/2267] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:53 2021] POST /identity/v3/users => generated 289 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:53.894459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fda1d-6d30-4601-9527-331ff8de9dd2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:53.915495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fda1d-6d30-4601-9527-331ff8de9dd2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:53.935268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30ef5a-c375-4a86-ace6-618cfa111133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:53.936346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ef5a-c375-4a86-ace6-618cfa111133 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:53.936856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ef5a-c375-4a86-ace6-618cfa111133 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:53.937534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ef5a-c375-4a86-ace6-618cfa111133 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:53.938943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30ef5a-c375-4a86-ace6-618cfa111133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:53.989259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30ef5a-c375-4a86-ace6-618cfa111133 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:54.026253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1130/2268] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:53 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:54.040899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8fc3d-eb32-45ef-8b8f-97fcd8342236 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:54.073767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8fc3d-eb32-45ef-8b8f-97fcd8342236 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:54.109026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3dbbe-056c-4834-b98a-3b298580c14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:54.110477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3dbbe-056c-4834-b98a-3b298580c14c admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:54.111008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3dbbe-056c-4834-b98a-3b298580c14c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:54.111660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3dbbe-056c-4834-b98a-3b298580c14c admin admin] PATH_INFO: `/v3/projects/8f0c6631a20f40c0afdce8a3c103cb50/users/72f15331e8fb4e2a9d62d37c8615ca52/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:54.261809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3dbbe-056c-4834-b98a-3b298580c14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0c6631a20f40c0afdce8a3c103cb50, user_id=72f15331e8fb4e2a9d62d37c8615ca52, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:54.440576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3dbbe-056c-4834-b98a-3b298580c14c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:54.502078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1139/2269] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:54 2021] PUT /identity/v3/projects/8f0c6631a20f40c0afdce8a3c103cb50/users/72f15331e8fb4e2a9d62d37c8615ca52/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:54.516775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7c64-eff6-4487-8e15-6706063e1b9c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:54.520994 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7c64-eff6-4487-8e15-6706063e1b9c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:54.521557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7c64-eff6-4487-8e15-6706063e1b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:54.718856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-66dd7c64-eff6-4487-8e15-6706063e1b9c None None] MFA Rules not processed for user `72f15331e8fb4e2a9d62d37c8615ca52`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:54.723010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-66dd7c64-eff6-4487-8e15-6706063e1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:55.011647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1131/2270] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:54 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:55.019447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3dbbe-056c-4834-b98a-3b298580c14c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:55.275760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3dbbe-056c-4834-b98a-3b298580c14c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:55.287302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a17f8-faec-4364-aec7-e13f4ee850ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:55.288331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a17f8-faec-4364-aec7-e13f4ee850ac admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:55.288811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a17f8-faec-4364-aec7-e13f4ee850ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:55.289290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a17f8-faec-4364-aec7-e13f4ee850ac admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:55.292659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a17f8-faec-4364-aec7-e13f4ee850ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:55.418158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a17f8-faec-4364-aec7-e13f4ee850ac admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:55.490268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1140/2271] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:55 2021] POST /identity/v3/projects => generated 375 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:55.494796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7c64-eff6-4487-8e15-6706063e1b9c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:55.528464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7c64-eff6-4487-8e15-6706063e1b9c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:55.738207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0e01-27a2-40d4-a3b9-fbae75ed3956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:55.739242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0e01-27a2-40d4-a3b9-fbae75ed3956 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:55.739534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0e01-27a2-40d4-a3b9-fbae75ed3956 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:55.739851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0e01-27a2-40d4-a3b9-fbae75ed3956 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:55.740860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d0e01-27a2-40d4-a3b9-fbae75ed3956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:55.771312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d0e01-27a2-40d4-a3b9-fbae75ed3956 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:55.829760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1132/2272] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:55 2021] POST /identity/v3/users => generated 288 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:55.833504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a17f8-faec-4364-aec7-e13f4ee850ac admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:55.864803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a17f8-faec-4364-aec7-e13f4ee850ac admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:55.878839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1995759-c6d2-4378-a5c4-293a68c045d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:55.880072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1995759-c6d2-4378-a5c4-293a68c045d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:55.881029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1995759-c6d2-4378-a5c4-293a68c045d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:55.881984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1995759-c6d2-4378-a5c4-293a68c045d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:55.883716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1995759-c6d2-4378-a5c4-293a68c045d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:55.937088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1995759-c6d2-4378-a5c4-293a68c045d9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:55.962890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1141/2273] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:55 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:55.968560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0e01-27a2-40d4-a3b9-fbae75ed3956 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:55.998179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0e01-27a2-40d4-a3b9-fbae75ed3956 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:56.011344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa10b5-c862-45fd-82d6-d82dd1371c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:56.015547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa10b5-c862-45fd-82d6-d82dd1371c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.016621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa10b5-c862-45fd-82d6-d82dd1371c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.017366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa10b5-c862-45fd-82d6-d82dd1371c93 admin admin] PATH_INFO: `/v3/projects/1719d10d1b9c458883ad8f168b7e7367/users/fda0cedd89584a7cae7934cbe504ee12/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.071375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa10b5-c862-45fd-82d6-d82dd1371c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1719d10d1b9c458883ad8f168b7e7367, user_id=fda0cedd89584a7cae7934cbe504ee12, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:56.135025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa10b5-c862-45fd-82d6-d82dd1371c93 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:56.175777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1133/2274] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:55 2021] PUT /identity/v3/projects/1719d10d1b9c458883ad8f168b7e7367/users/fda0cedd89584a7cae7934cbe504ee12/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:56.195639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57491-62aa-4c3c-96f8-f44f0546f301 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.202438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57491-62aa-4c3c-96f8-f44f0546f301 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.203032 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57491-62aa-4c3c-96f8-f44f0546f301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.387479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-31f57491-62aa-4c3c-96f8-f44f0546f301 None None] MFA Rules not processed for user `fda0cedd89584a7cae7934cbe504ee12`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:56.389605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-31f57491-62aa-4c3c-96f8-f44f0546f301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:40:56.755119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1142/2275] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:56 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 557 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:40:56.756758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa10b5-c862-45fd-82d6-d82dd1371c93 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:56.928352 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa10b5-c862-45fd-82d6-d82dd1371c93 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:56.941801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c26b32-af4a-4fb1-9ddb-20f7cdabd689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:56.944547 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26b32-af4a-4fb1-9ddb-20f7cdabd689 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:56.944858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26b32-af4a-4fb1-9ddb-20f7cdabd689 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:56.946399 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26b32-af4a-4fb1-9ddb-20f7cdabd689 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:56.947509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c26b32-af4a-4fb1-9ddb-20f7cdabd689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:56.988518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c26b32-af4a-4fb1-9ddb-20f7cdabd689 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:57.056171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1134/2276] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:40:56 2021] POST /identity/v3/projects => generated 375 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:57.063313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57491-62aa-4c3c-96f8-f44f0546f301 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:57.084453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57491-62aa-4c3c-96f8-f44f0546f301 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:57.357505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85470c-120f-4963-9c20-96c3f63dac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:57.371305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85470c-120f-4963-9c20-96c3f63dac62 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:57.371724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85470c-120f-4963-9c20-96c3f63dac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:57.372065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85470c-120f-4963-9c20-96c3f63dac62 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:57.372855 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85470c-120f-4963-9c20-96c3f63dac62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:57.434046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85470c-120f-4963-9c20-96c3f63dac62 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:57.490424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1143/2277] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:40:57 2021] POST /identity/v3/users => generated 294 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:40:57.492834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c26b32-af4a-4fb1-9ddb-20f7cdabd689 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:57.520082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c26b32-af4a-4fb1-9ddb-20f7cdabd689 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:57.554133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01215dac-c458-4560-a157-76104eba557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:57.555282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01215dac-c458-4560-a157-76104eba557d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:57.555816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01215dac-c458-4560-a157-76104eba557d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:57.556339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01215dac-c458-4560-a157-76104eba557d admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:57.558192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01215dac-c458-4560-a157-76104eba557d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:57.692624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01215dac-c458-4560-a157-76104eba557d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:57.792514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1135/2278] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:57 2021] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:57.799161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85470c-120f-4963-9c20-96c3f63dac62 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:57.828512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85470c-120f-4963-9c20-96c3f63dac62 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:57.863300 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494f3d5-b14c-46ae-af7f-41d63f44bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:57.871719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f3d5-b14c-46ae-af7f-41d63f44bf0d admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:57.872254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f3d5-b14c-46ae-af7f-41d63f44bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:57.872747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f3d5-b14c-46ae-af7f-41d63f44bf0d admin admin] PATH_INFO: `/v3/projects/26c2c79de490470cb160733c725c0c74/users/84c92ff4d40a45299930ea2657fe89f6/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:58.006658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494f3d5-b14c-46ae-af7f-41d63f44bf0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c2c79de490470cb160733c725c0c74, user_id=84c92ff4d40a45299930ea2657fe89f6, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:58.143789 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494f3d5-b14c-46ae-af7f-41d63f44bf0d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:58.181055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1144/2279] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:57 2021] PUT /identity/v3/projects/26c2c79de490470cb160733c725c0c74/users/84c92ff4d40a45299930ea2657fe89f6/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:40:58.186614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01215dac-c458-4560-a157-76104eba557d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:58.213140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01215dac-c458-4560-a157-76104eba557d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:58.560267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a80b27-db05-4e2e-9e06-cfcb1915e48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:58.561185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a80b27-db05-4e2e-9e06-cfcb1915e48b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:58.561942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a80b27-db05-4e2e-9e06-cfcb1915e48b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:58.562444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a80b27-db05-4e2e-9e06-cfcb1915e48b admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:58.563358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a80b27-db05-4e2e-9e06-cfcb1915e48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:58.732059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a80b27-db05-4e2e-9e06-cfcb1915e48b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:58.806788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1136/2280] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:58 2021] GET /identity/v3/roles => generated 1420 bytes in 621 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:40:58.815674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494f3d5-b14c-46ae-af7f-41d63f44bf0d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:58.839978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494f3d5-b14c-46ae-af7f-41d63f44bf0d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:58.856123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f9f69-d613-4c2b-b5ad-ca6e0a2bcc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:58.857141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f9f69-d613-4c2b-b5ad-ca6e0a2bcc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:58.857324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f9f69-d613-4c2b-b5ad-ca6e0a2bcc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:58.857795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f9f69-d613-4c2b-b5ad-ca6e0a2bcc72 admin admin] PATH_INFO: `/v3/projects/26c2c79de490470cb160733c725c0c74/users/84c92ff4d40a45299930ea2657fe89f6/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:58.864566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f9f69-d613-4c2b-b5ad-ca6e0a2bcc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c2c79de490470cb160733c725c0c74, user_id=84c92ff4d40a45299930ea2657fe89f6, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:58.922012 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f9f69-d613-4c2b-b5ad-ca6e0a2bcc72 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:58.960147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1145/2281] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:58 2021] PUT /identity/v3/projects/26c2c79de490470cb160733c725c0c74/users/84c92ff4d40a45299930ea2657fe89f6/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:58.964655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a80b27-db05-4e2e-9e06-cfcb1915e48b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:58.998357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a80b27-db05-4e2e-9e06-cfcb1915e48b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:59.381790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50c2a1-d3fe-4c26-b33a-c9ae2330fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:59.383232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50c2a1-d3fe-4c26-b33a-c9ae2330fa94 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.383924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50c2a1-d3fe-4c26-b33a-c9ae2330fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.384645 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50c2a1-d3fe-4c26-b33a-c9ae2330fa94 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.387874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50c2a1-d3fe-4c26-b33a-c9ae2330fa94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:59.501702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50c2a1-d3fe-4c26-b33a-c9ae2330fa94 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:59.534867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1137/2282] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:40:58 2021] GET /identity/v3/roles => generated 1420 bytes in 571 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:40:59.540736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f9f69-d613-4c2b-b5ad-ca6e0a2bcc72 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:40:59.561848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f9f69-d613-4c2b-b5ad-ca6e0a2bcc72 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:40:59.583413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879bb4d-71fa-400e-b88d-53ae2decef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:40:59.584488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879bb4d-71fa-400e-b88d-53ae2decef39 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.584767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879bb4d-71fa-400e-b88d-53ae2decef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.585136 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879bb4d-71fa-400e-b88d-53ae2decef39 admin admin] PATH_INFO: `/v3/projects/26c2c79de490470cb160733c725c0c74/users/84c92ff4d40a45299930ea2657fe89f6/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.589324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879bb4d-71fa-400e-b88d-53ae2decef39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c2c79de490470cb160733c725c0c74, user_id=84c92ff4d40a45299930ea2657fe89f6, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:40:59.665368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879bb4d-71fa-400e-b88d-53ae2decef39 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:40:59.712949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1146/2283] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:40:59 2021] PUT /identity/v3/projects/26c2c79de490470cb160733c725c0c74/users/84c92ff4d40a45299930ea2657fe89f6/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:40:59.720696 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649568b7-e62b-47b7-ad67-9fc2338122a3 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:40:59.721177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649568b7-e62b-47b7-ad67-9fc2338122a3 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:40:59.722025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649568b7-e62b-47b7-ad67-9fc2338122a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:40:59.882976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-649568b7-e62b-47b7-ad67-9fc2338122a3 None None] MFA Rules not processed for user `84c92ff4d40a45299930ea2657fe89f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:40:59.885311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-649568b7-e62b-47b7-ad67-9fc2338122a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:00.425376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1138/2284] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:40:59 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 710 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:00.444407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879bb4d-71fa-400e-b88d-53ae2decef39 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:00.453441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7879bb4d-71fa-400e-b88d-53ae2decef39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:00.871260 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879bb4d-71fa-400e-b88d-53ae2decef39 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:00.887766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d022a-1bda-4d0b-b6a9-fde1e843ce25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:00.888842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d022a-1bda-4d0b-b6a9-fde1e843ce25 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:00.889346 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d022a-1bda-4d0b-b6a9-fde1e843ce25 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:00.889853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d022a-1bda-4d0b-b6a9-fde1e843ce25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:01.111706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d022a-1bda-4d0b-b6a9-fde1e843ce25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:01.160563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d022a-1bda-4d0b-b6a9-fde1e843ce25 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:01.174783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1147/2285] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:00 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:05.387950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649568b7-e62b-47b7-ad67-9fc2338122a3 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:05.415817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649568b7-e62b-47b7-ad67-9fc2338122a3 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:05.424250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ded95-5c96-4eb0-8496-d4d52dc081f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:05.425624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ded95-5c96-4eb0-8496-d4d52dc081f0 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:05.426368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ded95-5c96-4eb0-8496-d4d52dc081f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:05.432109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ded95-5c96-4eb0-8496-d4d52dc081f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:05.702984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ded95-5c96-4eb0-8496-d4d52dc081f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:05.770320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ded95-5c96-4eb0-8496-d4d52dc081f0 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:05.807932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b25c24-9e70-4305-8152-b147b8b15fad None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:05.808883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b25c24-9e70-4305-8152-b147b8b15fad None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:05.809335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b25c24-9e70-4305-8152-b147b8b15fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:05.809627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1139/2286] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:05 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:05.841786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d3b25c24-9e70-4305-8152-b147b8b15fad None None] MFA Rules not processed for user `f642c76a379d43fe97078fb43b7477dc`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:05.843467 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d3b25c24-9e70-4305-8152-b147b8b15fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:05.985411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1148/2287] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:05 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:07.525009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ded95-5c96-4eb0-8496-d4d52dc081f0 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:07.539652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ded95-5c96-4eb0-8496-d4d52dc081f0 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:07.543886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97785-a25b-4c82-bfd3-33abe95e705d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:07.544497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97785-a25b-4c82-bfd3-33abe95e705d service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:07.544784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97785-a25b-4c82-bfd3-33abe95e705d service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:07.545069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97785-a25b-4c82-bfd3-33abe95e705d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:07.558918 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a97785-a25b-4c82-bfd3-33abe95e705d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:07.589488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a97785-a25b-4c82-bfd3-33abe95e705d service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:07.603635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1140/2288] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:07 2021] GET /identity/v3/auth/tokens => generated 3749 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:08.910038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651134-5b87-4529-badf-ab4554c056f0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:08.910607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651134-5b87-4529-badf-ab4554c056f0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:08.911270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651134-5b87-4529-badf-ab4554c056f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:08.978885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9a651134-5b87-4529-badf-ab4554c056f0 None None] MFA Rules not processed for user `6277cfcd4a084454ab52b5efd15c2dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:08.981249 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9a651134-5b87-4529-badf-ab4554c056f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:09.218067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1149/2289] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:08 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:09.261635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97785-a25b-4c82-bfd3-33abe95e705d service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:09.263918 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d7a97785-a25b-4c82-bfd3-33abe95e705d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:09.608448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97785-a25b-4c82-bfd3-33abe95e705d service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:09.621564 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6f22-8da3-4ed5-894f-9d355f673d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:09.622838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6f22-8da3-4ed5-894f-9d355f673d99 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:09.623424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6f22-8da3-4ed5-894f-9d355f673d99 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:09.624020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6f22-8da3-4ed5-894f-9d355f673d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:09.628269 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-89cb6f22-8da3-4ed5-894f-9d355f673d99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:09.843420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6f22-8da3-4ed5-894f-9d355f673d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:09.928581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6f22-8da3-4ed5-894f-9d355f673d99 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:09.982606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1141/2290] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:09 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:41:14.679462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651134-5b87-4529-badf-ab4554c056f0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:14.808562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651134-5b87-4529-badf-ab4554c056f0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:14.816473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:14.819045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:14.819549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:14.820038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] PATH_INFO: `/v3/users/72f15331e8fb4e2a9d62d37c8615ca52` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:14.822382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f15331e8fb4e2a9d62d37c8615ca52)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:14.889602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:15.060410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f15331e8fb4e2a9d62d37c8615ca52'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:15.083983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f15331e8fb4e2a9d62d37c8615ca52'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:15.086022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f15331e8fb4e2a9d62d37c8615ca52'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:15.102743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f15331e8fb4e2a9d62d37c8615ca52'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:15.163335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f15331e8fb4e2a9d62d37c8615ca52'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:15.197430 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1150/2291] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:41:14 2021] DELETE /identity/v3/users/72f15331e8fb4e2a9d62d37c8615ca52 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:15.199905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb11028-2974-4988-a84f-3bb300b344f5 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:15.200697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb11028-2974-4988-a84f-3bb300b344f5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:15.201136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb11028-2974-4988-a84f-3bb300b344f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:15.270155 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6bb11028-2974-4988-a84f-3bb300b344f5 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:15.273093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6bb11028-2974-4988-a84f-3bb300b344f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:15.476855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1142/2292] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:15.553829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:15.556815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:15.781888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af614b-d9f5-44a1-bd27-bbafe493546e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:15.796438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e5e6-146d-4680-bc8f-0ff91c36cf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:15.796995 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e5e6-146d-4680-bc8f-0ff91c36cf9f service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:15.797384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e5e6-146d-4680-bc8f-0ff91c36cf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:15.797737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e5e6-146d-4680-bc8f-0ff91c36cf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:15.819897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16e5e6-146d-4680-bc8f-0ff91c36cf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:15.842449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790b78-bb3a-4668-b10c-99f19e78a11d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:15.844017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790b78-bb3a-4668-b10c-99f19e78a11d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:15.844653 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790b78-bb3a-4668-b10c-99f19e78a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:15.875059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16e5e6-146d-4680-bc8f-0ff91c36cf9f service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:15.891330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1151/2293] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:15.893757 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-25790b78-bb3a-4668-b10c-99f19e78a11d None None] MFA Rules not processed for user `60acaee6050143099c2ded8515eab3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:15.896582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-25790b78-bb3a-4668-b10c-99f19e78a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:16.042559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1143/2294] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:15 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:41:18.297784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e5e6-146d-4680-bc8f-0ff91c36cf9f service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:18.300115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-bc16e5e6-146d-4680-bc8f-0ff91c36cf9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:18.352400 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e5e6-146d-4680-bc8f-0ff91c36cf9f service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:18.358020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:18.359277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:18.359784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:18.360340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] PATH_INFO: `/v3/projects/8f0c6631a20f40c0afdce8a3c103cb50` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:18.361909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0c6631a20f40c0afdce8a3c103cb50)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:18.401924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:18.562287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0c6631a20f40c0afdce8a3c103cb50', 'request_id': 'req-c4c6259c-8f3c-4e20-a4d6-1248a333062e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:18.631169 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0c6631a20f40c0afdce8a3c103cb50', 'request_id': 'req-c4c6259c-8f3c-4e20-a4d6-1248a333062e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:18.674125 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0c6631a20f40c0afdce8a3c103cb50', 'request_id': 'req-c4c6259c-8f3c-4e20-a4d6-1248a333062e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:18.707871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] The token cache is being invalidate because project 8f0c6631a20f40c0afdce8a3c103cb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:41:18.708827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:18.711610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:18.720371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1152/2295] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:41:18 2021] DELETE /identity/v3/projects/8f0c6631a20f40c0afdce8a3c103cb50 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:41:18.725772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790b78-bb3a-4668-b10c-99f19e78a11d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:18.780353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790b78-bb3a-4668-b10c-99f19e78a11d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:19.079742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:19.081211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:19.081742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:19.089096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] PATH_INFO: `/v3/users/fda0cedd89584a7cae7934cbe504ee12` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:19.091357 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda0cedd89584a7cae7934cbe504ee12)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:19.255020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:19.492077 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda0cedd89584a7cae7934cbe504ee12'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:19.528335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda0cedd89584a7cae7934cbe504ee12'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:19.548428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda0cedd89584a7cae7934cbe504ee12'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:19.550229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda0cedd89584a7cae7934cbe504ee12'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:19.573069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-1ad1dc77-dbf2-4fdb-98f7-cab25b9add02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda0cedd89584a7cae7934cbe504ee12'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:19.606559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1144/2296] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:41:18 2021] DELETE /identity/v3/users/fda0cedd89584a7cae7934cbe504ee12 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:20.827350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:20.831004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:20.867763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6259c-8f3c-4e20-a4d6-1248a333062e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:21.057025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:21.058552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:21.059350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:21.059996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] PATH_INFO: `/v3/projects/1719d10d1b9c458883ad8f168b7e7367` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:21.062076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1719d10d1b9c458883ad8f168b7e7367)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:21.126676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:21.253786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1719d10d1b9c458883ad8f168b7e7367', 'request_id': 'req-d344467f-ed69-4e12-9b2d-684c26ed6ae8'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.272006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1719d10d1b9c458883ad8f168b7e7367', 'request_id': 'req-d344467f-ed69-4e12-9b2d-684c26ed6ae8'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.286345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1719d10d1b9c458883ad8f168b7e7367', 'request_id': 'req-d344467f-ed69-4e12-9b2d-684c26ed6ae8'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.308100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f993-327c-4cd2-a982-705fd7036a7c None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:21.308676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] The token cache is being invalidate because project 1719d10d1b9c458883ad8f168b7e7367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:41:21.308947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.309343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f993-327c-4cd2-a982-705fd7036a7c None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:21.309657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f993-327c-4cd2-a982-705fd7036a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:21.310303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.312309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1153/2297] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:41:20 2021] DELETE /identity/v3/projects/1719d10d1b9c458883ad8f168b7e7367 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:21.316514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:21.318657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:21.441040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-7409f993-327c-4cd2-a982-705fd7036a7c None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:21.442329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7409f993-327c-4cd2-a982-705fd7036a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:21.514884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344467f-ed69-4e12-9b2d-684c26ed6ae8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:21.525494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:21.526865 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:21.527564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:21.528062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] PATH_INFO: `/v3/users/84c92ff4d40a45299930ea2657fe89f6` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:21.529725 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c92ff4d40a45299930ea2657fe89f6)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:21.598141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:21.699027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c92ff4d40a45299930ea2657fe89f6'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.722502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c92ff4d40a45299930ea2657fe89f6'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.725893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c92ff4d40a45299930ea2657fe89f6'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.762894 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1145/2298] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:41:21 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:21.765378 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c92ff4d40a45299930ea2657fe89f6'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.876340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c92ff4d40a45299930ea2657fe89f6'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:21.877295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f993-327c-4cd2-a982-705fd7036a7c None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:21.878660 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7409f993-327c-4cd2-a982-705fd7036a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:21.926113 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1154/2299] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:41:21 2021] DELETE /identity/v3/users/84c92ff4d40a45299930ea2657fe89f6 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:41:22.239235 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f993-327c-4cd2-a982-705fd7036a7c None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:22.425412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1c010-9541-4c36-adb3-5bc24461ea43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:22.426499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1c010-9541-4c36-adb3-5bc24461ea43 service swift] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:22.426499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1c010-9541-4c36-adb3-5bc24461ea43 service swift] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:22.426806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1c010-9541-4c36-adb3-5bc24461ea43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:22.431244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-50a1c010-9541-4c36-adb3-5bc24461ea43 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:22.593834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1c010-9541-4c36-adb3-5bc24461ea43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:22.629057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1c010-9541-4c36-adb3-5bc24461ea43 service swift] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:22.671082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1146/2300] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:41:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:41:23.800475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:23.819068 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:23.986888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42c40c-541b-4370-ad0f-502eb17e97e6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:24.002359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:24.003905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:24.004374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:24.006137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] PATH_INFO: `/v3/projects/26c2c79de490470cb160733c725c0c74` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:24.008383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c2c79de490470cb160733c725c0c74)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:24.044947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:24.243170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c2c79de490470cb160733c725c0c74', 'request_id': 'req-350037fe-50e4-445c-8bd1-46a678b67b4e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:24.304098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c2c79de490470cb160733c725c0c74', 'request_id': 'req-350037fe-50e4-445c-8bd1-46a678b67b4e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:24.329464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c2c79de490470cb160733c725c0c74', 'request_id': 'req-350037fe-50e4-445c-8bd1-46a678b67b4e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:24.401933 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] The token cache is being invalidate because project 26c2c79de490470cb160733c725c0c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:41:24.403153 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:24.405256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-350037fe-50e4-445c-8bd1-46a678b67b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:24.422076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1155/2301] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:41:23 2021] DELETE /identity/v3/projects/26c2c79de490470cb160733c725c0c74 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:24.423434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abe65-ad64-4ef6-92b1-235bbc8398a1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:24.424851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abe65-ad64-4ef6-92b1-235bbc8398a1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:24.425562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abe65-ad64-4ef6-92b1-235bbc8398a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:24.512554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-f25abe65-ad64-4ef6-92b1-235bbc8398a1 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:24.514217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f25abe65-ad64-4ef6-92b1-235bbc8398a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:24.763732 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1147/2302] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:41:24.784585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235138d-951d-40f1-bd14-a0296c185f05 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:24.784585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235138d-951d-40f1-bd14-a0296c185f05 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:24.784905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235138d-951d-40f1-bd14-a0296c185f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:24.909100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d235138d-951d-40f1-bd14-a0296c185f05 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:24.912999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d235138d-951d-40f1-bd14-a0296c185f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:24.930552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1156/2303] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:24.947173 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25abe65-ad64-4ef6-92b1-235bbc8398a1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:24.970997 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25abe65-ad64-4ef6-92b1-235bbc8398a1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:24.992020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e044ba-39ed-4259-b0c5-8173b424b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:24.992989 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e044ba-39ed-4259-b0c5-8173b424b2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:24.995461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e044ba-39ed-4259-b0c5-8173b424b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:24.996152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e044ba-39ed-4259-b0c5-8173b424b2f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:24.997425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e044ba-39ed-4259-b0c5-8173b424b2f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:41:24.997918 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e044ba-39ed-4259-b0c5-8173b424b2f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:25.215902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e044ba-39ed-4259-b0c5-8173b424b2f3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:25.278782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1148/2304] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:41:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:41:25.281332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235138d-951d-40f1-bd14-a0296c185f05 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:25.341664 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235138d-951d-40f1-bd14-a0296c185f05 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:25.384897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9cf83-1ce9-4f0a-9675-20a779944bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:25.391560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9cf83-1ce9-4f0a-9675-20a779944bfa admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:25.392581 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9cf83-1ce9-4f0a-9675-20a779944bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:25.393093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9cf83-1ce9-4f0a-9675-20a779944bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:25.394497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9cf83-1ce9-4f0a-9675-20a779944bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:25.478722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9cf83-1ce9-4f0a-9675-20a779944bfa admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:25.548078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1157/2305] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:41:25 2021] POST /identity/v3/projects => generated 391 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:41:25.565630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e044ba-39ed-4259-b0c5-8173b424b2f3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:25.606877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e044ba-39ed-4259-b0c5-8173b424b2f3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:25.870147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faa3e0-7af9-4388-bef0-aac6caa4e76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:25.870776 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faa3e0-7af9-4388-bef0-aac6caa4e76f admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:25.871068 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faa3e0-7af9-4388-bef0-aac6caa4e76f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:25.871349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faa3e0-7af9-4388-bef0-aac6caa4e76f admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:25.872022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24faa3e0-7af9-4388-bef0-aac6caa4e76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:25.909947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24faa3e0-7af9-4388-bef0-aac6caa4e76f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:25.950073 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1149/2306] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:41:25 2021] POST /identity/v3/users => generated 296 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:41:25.954384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9cf83-1ce9-4f0a-9675-20a779944bfa admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:26.001474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9cf83-1ce9-4f0a-9675-20a779944bfa admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:26.009473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051fc9d-dff6-4a90-8437-7edf234288fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:26.010456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051fc9d-dff6-4a90-8437-7edf234288fe admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:26.010861 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051fc9d-dff6-4a90-8437-7edf234288fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:26.011284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051fc9d-dff6-4a90-8437-7edf234288fe admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:26.012273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051fc9d-dff6-4a90-8437-7edf234288fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:26.051283 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051fc9d-dff6-4a90-8437-7edf234288fe admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:26.070149 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1158/2307] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:41:25 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:41:26.075749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faa3e0-7af9-4388-bef0-aac6caa4e76f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:26.096235 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faa3e0-7af9-4388-bef0-aac6caa4e76f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:26.105219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7af423-a3b8-46a4-9953-73c6209d890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:26.108175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7af423-a3b8-46a4-9953-73c6209d890d admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:26.109151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7af423-a3b8-46a4-9953-73c6209d890d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:26.109868 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7af423-a3b8-46a4-9953-73c6209d890d admin admin] PATH_INFO: `/v3/projects/c572e08aa79e4749871cd97b2b277eb4/users/7bb652ef38a94326aeafc0b78bda8878/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:26.154694 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7af423-a3b8-46a4-9953-73c6209d890d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c572e08aa79e4749871cd97b2b277eb4, user_id=7bb652ef38a94326aeafc0b78bda8878, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:26.187899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7af423-a3b8-46a4-9953-73c6209d890d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:26.215555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1150/2308] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:41:26 2021] PUT /identity/v3/projects/c572e08aa79e4749871cd97b2b277eb4/users/7bb652ef38a94326aeafc0b78bda8878/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:41:26.239379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e39e9-573b-4062-9721-08a6e7e870bc None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:26.240371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e39e9-573b-4062-9721-08a6e7e870bc None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:26.241180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e39e9-573b-4062-9721-08a6e7e870bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:26.385849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-915e39e9-573b-4062-9721-08a6e7e870bc None None] MFA Rules not processed for user `7bb652ef38a94326aeafc0b78bda8878`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:26.387603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-915e39e9-573b-4062-9721-08a6e7e870bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:26.626821 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1159/2309] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:26 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:26.643289 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7af423-a3b8-46a4-9953-73c6209d890d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:26.646680 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-bf7af423-a3b8-46a4-9953-73c6209d890d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:27.002206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7af423-a3b8-46a4-9953-73c6209d890d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:27.023065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bef2e7-0ad7-40f3-b988-f7c3a8e83a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:27.024693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bef2e7-0ad7-40f3-b988-f7c3a8e83a79 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:27.026437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bef2e7-0ad7-40f3-b988-f7c3a8e83a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:27.027559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bef2e7-0ad7-40f3-b988-f7c3a8e83a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:27.083133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bef2e7-0ad7-40f3-b988-f7c3a8e83a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:27.185241 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bef2e7-0ad7-40f3-b988-f7c3a8e83a79 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:27.211861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1151/2310] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:26 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:41:41.276592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e39e9-573b-4062-9721-08a6e7e870bc None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:41.280413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-915e39e9-573b-4062-9721-08a6e7e870bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:41.489798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e39e9-573b-4062-9721-08a6e7e870bc None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:41.498242 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:41.500319 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:41.500781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:41.501434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] PATH_INFO: `/v3/users/54784adec17748f8ae9a221f21cf8428` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:41.503657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54784adec17748f8ae9a221f21cf8428)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:41.564402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:41.701180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54784adec17748f8ae9a221f21cf8428'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:41.722727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54784adec17748f8ae9a221f21cf8428'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:41.724079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54784adec17748f8ae9a221f21cf8428'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:41.754233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54784adec17748f8ae9a221f21cf8428'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:41.777982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54784adec17748f8ae9a221f21cf8428'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:41.794764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1160/2311] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:41:41 2021] DELETE /identity/v3/users/54784adec17748f8ae9a221f21cf8428 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:41.795845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3def8-74f3-44c6-8e21-b521861c66f5 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:41.796567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3def8-74f3-44c6-8e21-b521861c66f5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:41.796567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3def8-74f3-44c6-8e21-b521861c66f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:41.847527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5de3def8-74f3-44c6-8e21-b521861c66f5 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:41.850156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5de3def8-74f3-44c6-8e21-b521861c66f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:42.012497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1152/2312] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:42.020238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:42.025783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:42.204985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33530-0472-43d2-ba24-69e0bd795445 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:42.208836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec755c9c-f37e-4f68-8c26-d82e03b5b90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:42.209563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec755c9c-f37e-4f68-8c26-d82e03b5b90f service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:42.209900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec755c9c-f37e-4f68-8c26-d82e03b5b90f service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:42.210496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec755c9c-f37e-4f68-8c26-d82e03b5b90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:42.223473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec755c9c-f37e-4f68-8c26-d82e03b5b90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:42.259950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec755c9c-f37e-4f68-8c26-d82e03b5b90f service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:42.286131 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1161/2313] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:41:43.479242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3def8-74f3-44c6-8e21-b521861c66f5 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:43.483274 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5de3def8-74f3-44c6-8e21-b521861c66f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:43.535223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3def8-74f3-44c6-8e21-b521861c66f5 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:43.574279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:43.575671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:43.576163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:43.576770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] PATH_INFO: `/v3/projects/d03993486f6f4ff6bfcccab2c2e3b72a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:43.582053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d03993486f6f4ff6bfcccab2c2e3b72a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:43.647162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:43.788677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd03993486f6f4ff6bfcccab2c2e3b72a', 'request_id': 'req-8c632a0a-666d-4377-8f72-3a3591c2b2a1'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:43.810963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd03993486f6f4ff6bfcccab2c2e3b72a', 'request_id': 'req-8c632a0a-666d-4377-8f72-3a3591c2b2a1'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:43.825675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd03993486f6f4ff6bfcccab2c2e3b72a', 'request_id': 'req-8c632a0a-666d-4377-8f72-3a3591c2b2a1'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:43.848972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] The token cache is being invalidate because project d03993486f6f4ff6bfcccab2c2e3b72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:41:43.849620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:43.854246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8c632a0a-666d-4377-8f72-3a3591c2b2a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:41:43.860057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1153/2314] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:41:43 2021] DELETE /identity/v3/projects/d03993486f6f4ff6bfcccab2c2e3b72a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:43.871654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade94f96-be42-4cdf-b1cd-fbbe888783c3 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:43.873473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade94f96-be42-4cdf-b1cd-fbbe888783c3 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:43.874509 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade94f96-be42-4cdf-b1cd-fbbe888783c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:43.915871 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-ade94f96-be42-4cdf-b1cd-fbbe888783c3 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:43.918747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ade94f96-be42-4cdf-b1cd-fbbe888783c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:44.142033 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1162/2315] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:44.153651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c358f-4046-41fd-b2f4-54028fd71ff4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:44.155259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c358f-4046-41fd-b2f4-54028fd71ff4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:44.155873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c358f-4046-41fd-b2f4-54028fd71ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:44.213345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-663c358f-4046-41fd-b2f4-54028fd71ff4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:44.215587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-663c358f-4046-41fd-b2f4-54028fd71ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:44.244036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1154/2316] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:44.246304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade94f96-be42-4cdf-b1cd-fbbe888783c3 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:44.275230 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade94f96-be42-4cdf-b1cd-fbbe888783c3 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:44.282925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a20ec1-10ab-42f1-82c7-e5ae118e3327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:44.284068 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a20ec1-10ab-42f1-82c7-e5ae118e3327 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:44.287414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a20ec1-10ab-42f1-82c7-e5ae118e3327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:44.287951 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a20ec1-10ab-42f1-82c7-e5ae118e3327 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:44.290688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a20ec1-10ab-42f1-82c7-e5ae118e3327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:41:44.291202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a20ec1-10ab-42f1-82c7-e5ae118e3327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:44.331409 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a20ec1-10ab-42f1-82c7-e5ae118e3327 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:44.362368 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1163/2317] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:41:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:41:44.364349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c358f-4046-41fd-b2f4-54028fd71ff4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:44.379841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c358f-4046-41fd-b2f4-54028fd71ff4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:44.386302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff524-7884-4655-b45e-4fc6402a0c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:44.387500 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff524-7884-4655-b45e-4fc6402a0c33 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:44.388080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff524-7884-4655-b45e-4fc6402a0c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:44.388774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff524-7884-4655-b45e-4fc6402a0c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:44.389686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ff524-7884-4655-b45e-4fc6402a0c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:44.432768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ff524-7884-4655-b45e-4fc6402a0c33 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:44.502073 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1155/2318] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:41:44 2021] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:41:44.506062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a20ec1-10ab-42f1-82c7-e5ae118e3327 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:44.525892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a20ec1-10ab-42f1-82c7-e5ae118e3327 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:44.682702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527691e-3a3f-478e-a83b-a3d3decff4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:44.683339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527691e-3a3f-478e-a83b-a3d3decff4bd admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:44.683648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527691e-3a3f-478e-a83b-a3d3decff4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:44.683895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527691e-3a3f-478e-a83b-a3d3decff4bd admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:44.684619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527691e-3a3f-478e-a83b-a3d3decff4bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:44.734195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527691e-3a3f-478e-a83b-a3d3decff4bd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:44.776648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1164/2319] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:41:44 2021] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:41:44.780051 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff524-7884-4655-b45e-4fc6402a0c33 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:44.798918 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff524-7884-4655-b45e-4fc6402a0c33 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:44.807339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f51c7-8309-478f-a187-fd8d15890cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:44.808305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f51c7-8309-478f-a187-fd8d15890cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:44.808758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f51c7-8309-478f-a187-fd8d15890cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:44.809200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f51c7-8309-478f-a187-fd8d15890cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:44.810491 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f51c7-8309-478f-a187-fd8d15890cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:44.865162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f51c7-8309-478f-a187-fd8d15890cb2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:44.896044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1156/2320] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:41:44 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:41:44.897603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527691e-3a3f-478e-a83b-a3d3decff4bd admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:44.935087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527691e-3a3f-478e-a83b-a3d3decff4bd admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:44.944266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3003c-0ab1-4209-a84a-5b7c64170c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:44.946379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3003c-0ab1-4209-a84a-5b7c64170c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:44.946983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3003c-0ab1-4209-a84a-5b7c64170c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:44.947819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3003c-0ab1-4209-a84a-5b7c64170c71 admin admin] PATH_INFO: `/v3/projects/91d62884dc0b475d86f93383eea89118/users/f1fa39911452459a81b35e052ae06fcf/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:44.995232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3003c-0ab1-4209-a84a-5b7c64170c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d62884dc0b475d86f93383eea89118, user_id=f1fa39911452459a81b35e052ae06fcf, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:45.135846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3003c-0ab1-4209-a84a-5b7c64170c71 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:45.181553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1165/2321] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:41:44 2021] PUT /identity/v3/projects/91d62884dc0b475d86f93383eea89118/users/f1fa39911452459a81b35e052ae06fcf/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:41:45.196055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d44fce-0731-43ac-885f-6f7f4d2ff81b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:45.196632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d44fce-0731-43ac-885f-6f7f4d2ff81b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:45.197042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d44fce-0731-43ac-885f-6f7f4d2ff81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:45.324649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-16d44fce-0731-43ac-885f-6f7f4d2ff81b None None] MFA Rules not processed for user `f1fa39911452459a81b35e052ae06fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:41:45.328219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-16d44fce-0731-43ac-885f-6f7f4d2ff81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:45.467394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1157/2322] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:41:45 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:41:45.478652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3003c-0ab1-4209-a84a-5b7c64170c71 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:41:45.481829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-fde3003c-0ab1-4209-a84a-5b7c64170c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:41:45.624944 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3003c-0ab1-4209-a84a-5b7c64170c71 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:41:45.632763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834a0c1-b0e2-438c-8e9c-ea839050fa1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:41:45.633779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a0c1-b0e2-438c-8e9c-ea839050fa1a service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:41:45.634487 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a0c1-b0e2-438c-8e9c-ea839050fa1a service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:41:45.635009 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a0c1-b0e2-438c-8e9c-ea839050fa1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:41:45.652350 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834a0c1-b0e2-438c-8e9c-ea839050fa1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:41:45.707076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834a0c1-b0e2-438c-8e9c-ea839050fa1a service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:41:45.736453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1166/2323] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:41:45 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:01.399641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5b29-d15e-4531-a0e4-cf8f3cc2362e None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:01.399641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5b29-d15e-4531-a0e4-cf8f3cc2362e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:01.400909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5b29-d15e-4531-a0e4-cf8f3cc2362e None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:01.401776 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1158/2324] 10.222.0.67 () {54 vars in 921 bytes} [Thu Dec 16 14:42:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:42:01.410857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa48d-a1ca-4caa-99ee-6dbe51420a19 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:01.411805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa48d-a1ca-4caa-99ee-6dbe51420a19 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:01.411975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa48d-a1ca-4caa-99ee-6dbe51420a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:01.484186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4cffa48d-a1ca-4caa-99ee-6dbe51420a19 None None] MFA Rules not processed for user `20905ef1afa847bc8f2f6f6e335f8bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:01.486791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4cffa48d-a1ca-4caa-99ee-6dbe51420a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:01.647392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1167/2325] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Dec 16 14:42:01 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:42:01.881014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5b29-d15e-4531-a0e4-cf8f3cc2362e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:01.883593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7cfe5b29-d15e-4531-a0e4-cf8f3cc2362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:01.898803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5b29-d15e-4531-a0e4-cf8f3cc2362e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:01.907915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb85a4d-e532-43e8-8188-78ad0ac68d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:01.909403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb85a4d-e532-43e8-8188-78ad0ac68d76 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:01.910262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb85a4d-e532-43e8-8188-78ad0ac68d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:01.911108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb85a4d-e532-43e8-8188-78ad0ac68d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:01.933257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb85a4d-e532-43e8-8188-78ad0ac68d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:01.966285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb85a4d-e532-43e8-8188-78ad0ac68d76 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:01.977379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1159/2326] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:01 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:42:05.075757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffa48d-a1ca-4caa-99ee-6dbe51420a19 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:05.078375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4cffa48d-a1ca-4caa-99ee-6dbe51420a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:05.251034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffa48d-a1ca-4caa-99ee-6dbe51420a19 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:05.258043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:05.260195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:05.260785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:05.261363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] PATH_INFO: `/v3/users/7bb652ef38a94326aeafc0b78bda8878` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:05.263610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb652ef38a94326aeafc0b78bda8878)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:05.320128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:05.433898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb652ef38a94326aeafc0b78bda8878'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:05.455001 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb652ef38a94326aeafc0b78bda8878'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:05.456680 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb652ef38a94326aeafc0b78bda8878'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:05.478061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb652ef38a94326aeafc0b78bda8878'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:05.589036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb652ef38a94326aeafc0b78bda8878'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:05.613246 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1168/2327] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:42:05 2021] DELETE /identity/v3/users/7bb652ef38a94326aeafc0b78bda8878 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:05.621344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1dd88-8a16-4523-bf32-5199f339350d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:05.621919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1dd88-8a16-4523-bf32-5199f339350d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:05.622579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1dd88-8a16-4523-bf32-5199f339350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:05.681469 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-f1e1dd88-8a16-4523-bf32-5199f339350d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:05.683033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f1e1dd88-8a16-4523-bf32-5199f339350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:05.781222 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1160/2328] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:05.795947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:05.798130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:05.881196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71baae5-8180-44c9-9526-3e6314bb4ea2 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:05.885066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da2aa2-0a1e-4829-843c-a0017b50c66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:05.885662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da2aa2-0a1e-4829-843c-a0017b50c66a service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:05.885950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da2aa2-0a1e-4829-843c-a0017b50c66a service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:05.886339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da2aa2-0a1e-4829-843c-a0017b50c66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:05.900495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da2aa2-0a1e-4829-843c-a0017b50c66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:05.943510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da2aa2-0a1e-4829-843c-a0017b50c66a service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:05.955868 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1169/2329] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:42:06.692443 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1dd88-8a16-4523-bf32-5199f339350d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:06.695633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f1e1dd88-8a16-4523-bf32-5199f339350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:06.713494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1dd88-8a16-4523-bf32-5199f339350d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:06.722221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:06.723948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:06.724599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:06.725244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] PATH_INFO: `/v3/projects/c572e08aa79e4749871cd97b2b277eb4` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:06.727752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c572e08aa79e4749871cd97b2b277eb4)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:06.767285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:06.840462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c572e08aa79e4749871cd97b2b277eb4', 'request_id': 'req-70071c05-7be6-4d46-9bf9-ab794edf162c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:06.862515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c572e08aa79e4749871cd97b2b277eb4', 'request_id': 'req-70071c05-7be6-4d46-9bf9-ab794edf162c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:06.872309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c572e08aa79e4749871cd97b2b277eb4', 'request_id': 'req-70071c05-7be6-4d46-9bf9-ab794edf162c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:06.884384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] The token cache is being invalidate because project c572e08aa79e4749871cd97b2b277eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:42:06.884816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:06.885505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70071c05-7be6-4d46-9bf9-ab794edf162c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:06.887073 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1161/2330] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:42:06 2021] DELETE /identity/v3/projects/c572e08aa79e4749871cd97b2b277eb4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:06.896782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98a5f-c64c-47fe-b53c-51dd11497b23 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:06.897436 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98a5f-c64c-47fe-b53c-51dd11497b23 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:06.897564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98a5f-c64c-47fe-b53c-51dd11497b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:06.942361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-7cd98a5f-c64c-47fe-b53c-51dd11497b23 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:06.945693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7cd98a5f-c64c-47fe-b53c-51dd11497b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:07.047443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1170/2331] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:07.057342 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8723-c996-489d-ae73-b2f3584e39c4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:07.057926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8723-c996-489d-ae73-b2f3584e39c4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:07.058869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8723-c996-489d-ae73-b2f3584e39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:07.099128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-904c8723-c996-489d-ae73-b2f3584e39c4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:07.101098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-904c8723-c996-489d-ae73-b2f3584e39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:07.114372 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1162/2332] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:07.120492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd98a5f-c64c-47fe-b53c-51dd11497b23 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:07.140322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd98a5f-c64c-47fe-b53c-51dd11497b23 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:07.146924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249d74-0631-4b5d-8848-56cbe6c3fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:07.147819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249d74-0631-4b5d-8848-56cbe6c3fca4 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:07.148415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249d74-0631-4b5d-8848-56cbe6c3fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:07.148985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249d74-0631-4b5d-8848-56cbe6c3fca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:07.150372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249d74-0631-4b5d-8848-56cbe6c3fca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:42:07.150946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249d74-0631-4b5d-8848-56cbe6c3fca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:07.199850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249d74-0631-4b5d-8848-56cbe6c3fca4 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:07.220813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1171/2333] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:42:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:42:07.226087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8723-c996-489d-ae73-b2f3584e39c4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:07.238094 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8723-c996-489d-ae73-b2f3584e39c4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:07.243146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e06a21-0f80-42b6-b1e2-c0ad1897cb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:07.244870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e06a21-0f80-42b6-b1e2-c0ad1897cb42 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:07.245242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e06a21-0f80-42b6-b1e2-c0ad1897cb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:07.245583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e06a21-0f80-42b6-b1e2-c0ad1897cb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:07.246299 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e06a21-0f80-42b6-b1e2-c0ad1897cb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:07.301217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e06a21-0f80-42b6-b1e2-c0ad1897cb42 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:07.350152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1163/2334] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:42:07 2021] POST /identity/v3/projects => generated 397 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:42:07.355324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249d74-0631-4b5d-8848-56cbe6c3fca4 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:07.366936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249d74-0631-4b5d-8848-56cbe6c3fca4 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:07.479548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110d5b4-9b01-4a09-bbf5-6135b1013b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:07.480274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d5b4-9b01-4a09-bbf5-6135b1013b16 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:07.480680 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d5b4-9b01-4a09-bbf5-6135b1013b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:07.481039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d5b4-9b01-4a09-bbf5-6135b1013b16 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:07.481749 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110d5b4-9b01-4a09-bbf5-6135b1013b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:07.510406 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110d5b4-9b01-4a09-bbf5-6135b1013b16 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:07.535640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1172/2335] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:42:07 2021] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:42:07.540630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e06a21-0f80-42b6-b1e2-c0ad1897cb42 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:07.552355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e06a21-0f80-42b6-b1e2-c0ad1897cb42 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:07.557578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010516a-0a08-4449-961b-3ca85977f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:07.558464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010516a-0a08-4449-961b-3ca85977f001 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:07.558926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010516a-0a08-4449-961b-3ca85977f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:07.559307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010516a-0a08-4449-961b-3ca85977f001 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:07.560365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010516a-0a08-4449-961b-3ca85977f001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:07.586651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010516a-0a08-4449-961b-3ca85977f001 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:07.598213 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1164/2336] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:42:07 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:42:07.602926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110d5b4-9b01-4a09-bbf5-6135b1013b16 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:07.613697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110d5b4-9b01-4a09-bbf5-6135b1013b16 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:07.619996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f85d8-6a13-4019-a337-a92a4b446570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:07.621180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f85d8-6a13-4019-a337-a92a4b446570 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:07.621556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f85d8-6a13-4019-a337-a92a4b446570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:07.622045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f85d8-6a13-4019-a337-a92a4b446570 admin admin] PATH_INFO: `/v3/projects/29e72ecfbbfb429aa5367e6494cf0ce3/users/462bb7943ed04b21a55898ec96cf5645/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:07.665651 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f85d8-6a13-4019-a337-a92a4b446570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e72ecfbbfb429aa5367e6494cf0ce3, user_id=462bb7943ed04b21a55898ec96cf5645, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:07.693526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f85d8-6a13-4019-a337-a92a4b446570 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:07.715100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1173/2337] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:42:07 2021] PUT /identity/v3/projects/29e72ecfbbfb429aa5367e6494cf0ce3/users/462bb7943ed04b21a55898ec96cf5645/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:42:07.735325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112222f-abe2-43e9-8f0f-91c0da637345 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:07.735976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112222f-abe2-43e9-8f0f-91c0da637345 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:07.736346 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112222f-abe2-43e9-8f0f-91c0da637345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:07.812406 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-2112222f-abe2-43e9-8f0f-91c0da637345 None None] MFA Rules not processed for user `462bb7943ed04b21a55898ec96cf5645`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:07.813646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2112222f-abe2-43e9-8f0f-91c0da637345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:07.948147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1165/2338] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:07 2021] POST /identity/v3/auth/tokens => generated 3704 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:07.960605 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f85d8-6a13-4019-a337-a92a4b446570 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:07.962485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a76f85d8-6a13-4019-a337-a92a4b446570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:08.039469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f85d8-6a13-4019-a337-a92a4b446570 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:08.043449 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e366a7-3763-43f0-8758-0ad961528f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:08.044054 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e366a7-3763-43f0-8758-0ad961528f76 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:08.044340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e366a7-3763-43f0-8758-0ad961528f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:08.044623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e366a7-3763-43f0-8758-0ad961528f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:08.054374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e366a7-3763-43f0-8758-0ad961528f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:08.080033 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e366a7-3763-43f0-8758-0ad961528f76 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:08.090842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1174/2339] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:07 2021] GET /identity/v3/auth/tokens => generated 3704 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:10.534249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d7eba-6a84-4719-8ecc-0c038f0dbc6f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:10.535187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d7eba-6a84-4719-8ecc-0c038f0dbc6f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:10.535187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d7eba-6a84-4719-8ecc-0c038f0dbc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:10.566104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-a63d7eba-6a84-4719-8ecc-0c038f0dbc6f None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:10.568059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a63d7eba-6a84-4719-8ecc-0c038f0dbc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:10.724933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1166/2340] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:42:10 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:42:10.740500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e366a7-3763-43f0-8758-0ad961528f76 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:10.741879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-28e366a7-3763-43f0-8758-0ad961528f76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:10.859508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e366a7-3763-43f0-8758-0ad961528f76 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:10.889780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b27d7c-aace-4c92-b483-a6da4c0f7e23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:10.890463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b27d7c-aace-4c92-b483-a6da4c0f7e23 service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:10.890742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b27d7c-aace-4c92-b483-a6da4c0f7e23 service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:10.891233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b27d7c-aace-4c92-b483-a6da4c0f7e23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:10.921044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b27d7c-aace-4c92-b483-a6da4c0f7e23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:10.984887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b27d7c-aace-4c92-b483-a6da4c0f7e23 service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:11.004010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1175/2341] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:42:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:11.311703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedaaae-7dd1-4fb5-893e-4e8ea0ae0e20 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:11.312477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedaaae-7dd1-4fb5-893e-4e8ea0ae0e20 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:11.312977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedaaae-7dd1-4fb5-893e-4e8ea0ae0e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:11.418682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-2aedaaae-7dd1-4fb5-893e-4e8ea0ae0e20 None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:11.424329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2aedaaae-7dd1-4fb5-893e-4e8ea0ae0e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:11.482018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1167/2342] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:42:11 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:11.483416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b27d7c-aace-4c92-b483-a6da4c0f7e23 service swift] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:11.503331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b27d7c-aace-4c92-b483-a6da4c0f7e23 service swift] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:11.517046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc51fc3-c40a-4843-8500-c386f70f53fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:11.518320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc51fc3-c40a-4843-8500-c386f70f53fb service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:11.519423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc51fc3-c40a-4843-8500-c386f70f53fb service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:11.521472 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc51fc3-c40a-4843-8500-c386f70f53fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:11.542812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc51fc3-c40a-4843-8500-c386f70f53fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:11.579875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc51fc3-c40a-4843-8500-c386f70f53fb service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:11.600505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1176/2343] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:42:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:21.072329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedaaae-7dd1-4fb5-893e-4e8ea0ae0e20 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:21.073966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2aedaaae-7dd1-4fb5-893e-4e8ea0ae0e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:21.335632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedaaae-7dd1-4fb5-893e-4e8ea0ae0e20 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:21.341827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:21.343430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:21.344828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:21.345348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] PATH_INFO: `/v3/users/f1fa39911452459a81b35e052ae06fcf` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:21.347258 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fa39911452459a81b35e052ae06fcf)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:21.398186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:21.510544 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fa39911452459a81b35e052ae06fcf'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:21.551872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fa39911452459a81b35e052ae06fcf'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:21.568624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fa39911452459a81b35e052ae06fcf'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:21.570012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fa39911452459a81b35e052ae06fcf'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:21.589268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fa39911452459a81b35e052ae06fcf'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:21.603120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1168/2344] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:42:21 2021] DELETE /identity/v3/users/f1fa39911452459a81b35e052ae06fcf => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:21.610914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90515c68-cf6c-444c-9d3a-64732fbefb65 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:21.611872 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90515c68-cf6c-444c-9d3a-64732fbefb65 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:21.611872 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90515c68-cf6c-444c-9d3a-64732fbefb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:21.675882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-90515c68-cf6c-444c-9d3a-64732fbefb65 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:21.677882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-90515c68-cf6c-444c-9d3a-64732fbefb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:21.842163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1177/2345] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:21.857793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:21.860223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:22.184192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4794d8-dbcc-4034-ac92-ac00273009e6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:22.213791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fcdd3-1337-4f72-9ede-e15d116f4e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:22.215157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fcdd3-1337-4f72-9ede-e15d116f4e21 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:22.215840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fcdd3-1337-4f72-9ede-e15d116f4e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:22.216518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fcdd3-1337-4f72-9ede-e15d116f4e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:22.255387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fcdd3-1337-4f72-9ede-e15d116f4e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:22.340746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fcdd3-1337-4f72-9ede-e15d116f4e21 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:22.383140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1169/2346] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:23.954590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90515c68-cf6c-444c-9d3a-64732fbefb65 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:23.956231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-90515c68-cf6c-444c-9d3a-64732fbefb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:23.970504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fcdd3-1337-4f72-9ede-e15d116f4e21 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:23.973239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-884fcdd3-1337-4f72-9ede-e15d116f4e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:23.993714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90515c68-cf6c-444c-9d3a-64732fbefb65 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:24.001720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:24.002632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:24.002916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:24.003415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] PATH_INFO: `/v3/projects/91d62884dc0b475d86f93383eea89118` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:24.013614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d62884dc0b475d86f93383eea89118)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:24.027799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fcdd3-1337-4f72-9ede-e15d116f4e21 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:24.046389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:24.047722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:24.050479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:24.051108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] PATH_INFO: `/v3/users/462bb7943ed04b21a55898ec96cf5645` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:24.054849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] RBAC: Authorizing `identity:delete_user(user_id=462bb7943ed04b21a55898ec96cf5645)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:24.123484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:24.139612 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:24.359772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462bb7943ed04b21a55898ec96cf5645'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.408870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d62884dc0b475d86f93383eea89118', 'request_id': 'req-889f4b88-cf28-49cb-a8d1-afc393083378'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.431413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d62884dc0b475d86f93383eea89118', 'request_id': 'req-889f4b88-cf28-49cb-a8d1-afc393083378'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.445682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462bb7943ed04b21a55898ec96cf5645'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.452481 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d62884dc0b475d86f93383eea89118', 'request_id': 'req-889f4b88-cf28-49cb-a8d1-afc393083378'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.498996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462bb7943ed04b21a55898ec96cf5645'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.499956 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] The token cache is being invalidate because project 91d62884dc0b475d86f93383eea89118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:42:24.500170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462bb7943ed04b21a55898ec96cf5645'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.500440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.501374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-889f4b88-cf28-49cb-a8d1-afc393083378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.508720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1178/2347] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:42:23 2021] DELETE /identity/v3/projects/91d62884dc0b475d86f93383eea89118 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:24.519267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdeac6-916d-4d07-afed-faf2e3a21fe8 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:24.519799 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdeac6-916d-4d07-afed-faf2e3a21fe8 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:24.520278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdeac6-916d-4d07-afed-faf2e3a21fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:24.529600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6627b099-4417-45c0-894a-6c809491666c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462bb7943ed04b21a55898ec96cf5645'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:24.569391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9ecdeac6-916d-4d07-afed-faf2e3a21fe8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:24.570588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1170/2348] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:42:23 2021] DELETE /identity/v3/users/462bb7943ed04b21a55898ec96cf5645 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:24.573812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be207ac3-106b-466d-bf17-a34ca0bea4ac None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:24.574345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9ecdeac6-916d-4d07-afed-faf2e3a21fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:24.574524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be207ac3-106b-466d-bf17-a34ca0bea4ac None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:24.574524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be207ac3-106b-466d-bf17-a34ca0bea4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:24.632300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-be207ac3-106b-466d-bf17-a34ca0bea4ac None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:24.635749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-be207ac3-106b-466d-bf17-a34ca0bea4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:24.847727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1179/2349] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:42:24.868011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb76990-6236-4276-8d87-5f3907be22e4 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:24.868448 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb76990-6236-4276-8d87-5f3907be22e4 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:24.868910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb76990-6236-4276-8d87-5f3907be22e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:24.910410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1171/2350] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:24.934728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be207ac3-106b-466d-bf17-a34ca0bea4ac None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:24.941520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-be207ac3-106b-466d-bf17-a34ca0bea4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:24.981273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-6eb76990-6236-4276-8d87-5f3907be22e4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:24.983262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-6eb76990-6236-4276-8d87-5f3907be22e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:25.000395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1180/2351] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:25.006090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb76990-6236-4276-8d87-5f3907be22e4 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:25.041359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb76990-6236-4276-8d87-5f3907be22e4 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:25.051904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e03cf-1637-426e-bb06-d8a3d03860ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:25.058173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e03cf-1637-426e-bb06-d8a3d03860ee admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:25.058974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e03cf-1637-426e-bb06-d8a3d03860ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:25.059655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e03cf-1637-426e-bb06-d8a3d03860ee admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:25.061427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e03cf-1637-426e-bb06-d8a3d03860ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:42:25.062427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e03cf-1637-426e-bb06-d8a3d03860ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:25.131253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e03cf-1637-426e-bb06-d8a3d03860ee admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:25.144786 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be207ac3-106b-466d-bf17-a34ca0bea4ac None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:25.151886 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df782e1e-7405-4017-9ca2-c9f5151da49b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:25.153036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df782e1e-7405-4017-9ca2-c9f5151da49b service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:25.153675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df782e1e-7405-4017-9ca2-c9f5151da49b service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:25.154240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df782e1e-7405-4017-9ca2-c9f5151da49b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:25.188051 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df782e1e-7405-4017-9ca2-c9f5151da49b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:25.191744 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1181/2352] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:42:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:42:25.196910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e03cf-1637-426e-bb06-d8a3d03860ee admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:25.232489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e03cf-1637-426e-bb06-d8a3d03860ee admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:25.246389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa791-63e5-43f1-9159-fffb89f75e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:25.247690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa791-63e5-43f1-9159-fffb89f75e59 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:25.248336 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa791-63e5-43f1-9159-fffb89f75e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:25.249264 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa791-63e5-43f1-9159-fffb89f75e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:25.251600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581aa791-63e5-43f1-9159-fffb89f75e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:25.326367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df782e1e-7405-4017-9ca2-c9f5151da49b service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:25.353649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581aa791-63e5-43f1-9159-fffb89f75e59 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:25.380738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1172/2353] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:25.443791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1182/2354] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:42:25 2021] POST /identity/v3/projects => generated 381 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:42:25.450424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df782e1e-7405-4017-9ca2-c9f5151da49b service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:25.463686 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df782e1e-7405-4017-9ca2-c9f5151da49b service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:25.753018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a972-d6f6-4c8a-bec4-75c30808549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:25.753861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a972-d6f6-4c8a-bec4-75c30808549e admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:25.754248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a972-d6f6-4c8a-bec4-75c30808549e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:25.754600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a972-d6f6-4c8a-bec4-75c30808549e admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:25.756224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a972-d6f6-4c8a-bec4-75c30808549e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:25.845151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a972-d6f6-4c8a-bec4-75c30808549e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:25.946679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1173/2355] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:42:25 2021] POST /identity/v3/users => generated 291 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:42:25.948595 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa791-63e5-43f1-9159-fffb89f75e59 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:25.991884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa791-63e5-43f1-9159-fffb89f75e59 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:26.022688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe7560-1e83-4f9c-a506-5e009ba9c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:26.025031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe7560-1e83-4f9c-a506-5e009ba9c48b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:26.025311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe7560-1e83-4f9c-a506-5e009ba9c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:26.025648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe7560-1e83-4f9c-a506-5e009ba9c48b admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:26.034505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe7560-1e83-4f9c-a506-5e009ba9c48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:26.170874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe7560-1e83-4f9c-a506-5e009ba9c48b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:26.207535 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1183/2356] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:42:25 2021] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:42:26.214921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a972-d6f6-4c8a-bec4-75c30808549e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:26.246561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a972-d6f6-4c8a-bec4-75c30808549e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:26.279468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e4dcb-2de9-40cb-9cb5-6ccf672a0f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:26.281819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e4dcb-2de9-40cb-9cb5-6ccf672a0f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:26.282880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e4dcb-2de9-40cb-9cb5-6ccf672a0f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:26.283666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e4dcb-2de9-40cb-9cb5-6ccf672a0f54 admin admin] PATH_INFO: `/v3/projects/841e959321694bbe969318fafd7f676b/users/62521c33250d4e528a7c1edd5c0dda0b/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:26.365403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e4dcb-2de9-40cb-9cb5-6ccf672a0f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841e959321694bbe969318fafd7f676b, user_id=62521c33250d4e528a7c1edd5c0dda0b, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:26.486661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e4dcb-2de9-40cb-9cb5-6ccf672a0f54 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:26.575853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1174/2357] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:42:26 2021] PUT /identity/v3/projects/841e959321694bbe969318fafd7f676b/users/62521c33250d4e528a7c1edd5c0dda0b/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:26.577844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e07db-3642-407e-9d68-45a51233775a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:26.578180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e07db-3642-407e-9d68-45a51233775a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:26.578544 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e07db-3642-407e-9d68-45a51233775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:26.731196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-1c2e07db-3642-407e-9d68-45a51233775a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:26.733168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1c2e07db-3642-407e-9d68-45a51233775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:27.082636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1184/2358] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:42:27.179454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e4dcb-2de9-40cb-9cb5-6ccf672a0f54 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:27.182688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3d3e4dcb-2de9-40cb-9cb5-6ccf672a0f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:27.594981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e4dcb-2de9-40cb-9cb5-6ccf672a0f54 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:27.600696 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a7fd0-3409-44bd-a335-921083425424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:27.601479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a7fd0-3409-44bd-a335-921083425424 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:27.601777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a7fd0-3409-44bd-a335-921083425424 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:27.602093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a7fd0-3409-44bd-a335-921083425424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:27.632912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a7fd0-3409-44bd-a335-921083425424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:27.731573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a7fd0-3409-44bd-a335-921083425424 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:27.785722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1175/2359] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:42:28.425395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e07db-3642-407e-9d68-45a51233775a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:28.428601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1c2e07db-3642-407e-9d68-45a51233775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:28.481680 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e07db-3642-407e-9d68-45a51233775a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:28.495354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:28.499408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:28.500494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:28.501463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] PATH_INFO: `/v3/projects/29e72ecfbbfb429aa5367e6494cf0ce3` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:28.504507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e72ecfbbfb429aa5367e6494cf0ce3)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:28.566577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:28.774782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e72ecfbbfb429aa5367e6494cf0ce3', 'request_id': 'req-c3599429-3eda-4622-9871-2c0ab83ab4bc'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:28.819218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e72ecfbbfb429aa5367e6494cf0ce3', 'request_id': 'req-c3599429-3eda-4622-9871-2c0ab83ab4bc'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:28.842145 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e72ecfbbfb429aa5367e6494cf0ce3', 'request_id': 'req-c3599429-3eda-4622-9871-2c0ab83ab4bc'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:28.889493 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] The token cache is being invalidate because project 29e72ecfbbfb429aa5367e6494cf0ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:42:28.895813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:28.898845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:28.905190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1185/2360] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:42:28 2021] DELETE /identity/v3/projects/29e72ecfbbfb429aa5367e6494cf0ce3 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:30.868723 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514831a6-8e0c-4333-b7e7-69e523d14b43 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:30.869480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514831a6-8e0c-4333-b7e7-69e523d14b43 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:30.870423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514831a6-8e0c-4333-b7e7-69e523d14b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:31.078374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-514831a6-8e0c-4333-b7e7-69e523d14b43 None None] MFA Rules not processed for user `62521c33250d4e528a7c1edd5c0dda0b`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:31.081620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-514831a6-8e0c-4333-b7e7-69e523d14b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:31.458785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1176/2361] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:30 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 592 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:31.468574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:31.471777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:31.753142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3599429-3eda-4622-9871-2c0ab83ab4bc admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:31.761812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba2ea0-893f-4423-a07b-d8236d27ae3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:31.762900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba2ea0-893f-4423-a07b-d8236d27ae3f service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:31.763444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba2ea0-893f-4423-a07b-d8236d27ae3f service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:31.763959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba2ea0-893f-4423-a07b-d8236d27ae3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:31.791323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba2ea0-893f-4423-a07b-d8236d27ae3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:31.860265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba2ea0-893f-4423-a07b-d8236d27ae3f service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:31.904108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1186/2362] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:31 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:42:34.455785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13487b-e84f-47ac-9796-399d1b2213b8 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:34.456783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13487b-e84f-47ac-9796-399d1b2213b8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:34.456783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13487b-e84f-47ac-9796-399d1b2213b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:34.500284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-eb13487b-e84f-47ac-9796-399d1b2213b8 None None] MFA Rules not processed for user `62521c33250d4e528a7c1edd5c0dda0b`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:34.502221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-eb13487b-e84f-47ac-9796-399d1b2213b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:34.523866 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1177/2363] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:34 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:42.493211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba2ea0-893f-4423-a07b-d8236d27ae3f service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:42.495010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5bba2ea0-893f-4423-a07b-d8236d27ae3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:42.671182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba2ea0-893f-4423-a07b-d8236d27ae3f service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:42.680279 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd283a91-e249-4e63-ae43-7399cbd5ebab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:42.681419 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd283a91-e249-4e63-ae43-7399cbd5ebab service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:42.681955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd283a91-e249-4e63-ae43-7399cbd5ebab service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:42.682814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd283a91-e249-4e63-ae43-7399cbd5ebab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:42.685136 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cd283a91-e249-4e63-ae43-7399cbd5ebab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:42.792764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd283a91-e249-4e63-ae43-7399cbd5ebab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:42.885197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd283a91-e249-4e63-ae43-7399cbd5ebab service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:42.944670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1187/2364] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:42 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:46.065758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13487b-e84f-47ac-9796-399d1b2213b8 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:46.067450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-eb13487b-e84f-47ac-9796-399d1b2213b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:46.083480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13487b-e84f-47ac-9796-399d1b2213b8 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:46.088112 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:46.089171 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:46.090059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:46.090752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:46.093358 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:46.109834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:46.140177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:46.154044 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1178/2365] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:46 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:49.934740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0b4b1-d6a0-49f6-a308-845754e696a5 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:49.935674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0b4b1-d6a0-49f6-a308-845754e696a5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:49.935824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0b4b1-d6a0-49f6-a308-845754e696a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:50.020724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-63f0b4b1-d6a0-49f6-a308-845754e696a5 None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:50.022810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-63f0b4b1-d6a0-49f6-a308-845754e696a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:50.213031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1188/2366] 10.222.0.67 () {58 vars in 967 bytes} [Thu Dec 16 14:42:49 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:50.246252 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:50.248936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:50.421620 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b948-0c7c-4597-8ca7-8af694df4b32 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:50.430639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bc4b1-bf4a-463e-a573-c4f497251086 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:50.432101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bc4b1-bf4a-463e-a573-c4f497251086 service swift] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:50.432838 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bc4b1-bf4a-463e-a573-c4f497251086 service swift] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:50.433907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bc4b1-bf4a-463e-a573-c4f497251086 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:50.454191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bc4b1-bf4a-463e-a573-c4f497251086 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:50.491747 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bc4b1-bf4a-463e-a573-c4f497251086 service swift] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:50.502552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1179/2367] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:42:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:52.267236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0b4b1-d6a0-49f6-a308-845754e696a5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:52.283210 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0b4b1-d6a0-49f6-a308-845754e696a5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:52.289594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbb7af-776f-4d9d-b0fe-f5ae3108a256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:52.295345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbb7af-776f-4d9d-b0fe-f5ae3108a256 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:52.295345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbb7af-776f-4d9d-b0fe-f5ae3108a256 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:52.295345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbb7af-776f-4d9d-b0fe-f5ae3108a256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:52.296185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f1bbb7af-776f-4d9d-b0fe-f5ae3108a256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:52.464298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbb7af-776f-4d9d-b0fe-f5ae3108a256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:52.518076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbb7af-776f-4d9d-b0fe-f5ae3108a256 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:52.550444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1189/2368] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:52 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:52.630432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc00fa-91d6-4c28-a593-9b416562be2f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:52.631077 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc00fa-91d6-4c28-a593-9b416562be2f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:52.631770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc00fa-91d6-4c28-a593-9b416562be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:52.674898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-67cc00fa-91d6-4c28-a593-9b416562be2f None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:52.677000 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-67cc00fa-91d6-4c28-a593-9b416562be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:52.691062 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1180/2369] 10.222.0.67 () {58 vars in 967 bytes} [Thu Dec 16 14:42:52 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:52.739935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbb7af-776f-4d9d-b0fe-f5ae3108a256 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:52.776198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbb7af-776f-4d9d-b0fe-f5ae3108a256 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:52.808396 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db497dfd-5ff0-4db9-bdd7-1cc1bf1eaa42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:52.809520 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db497dfd-5ff0-4db9-bdd7-1cc1bf1eaa42 service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:52.810028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db497dfd-5ff0-4db9-bdd7-1cc1bf1eaa42 service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:52.810464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db497dfd-5ff0-4db9-bdd7-1cc1bf1eaa42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:52.840364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db497dfd-5ff0-4db9-bdd7-1cc1bf1eaa42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:52.905609 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db497dfd-5ff0-4db9-bdd7-1cc1bf1eaa42 service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:52.922470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1190/2370] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:42:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:54.483054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc00fa-91d6-4c28-a593-9b416562be2f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:54.503643 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc00fa-91d6-4c28-a593-9b416562be2f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:54.510067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdaaaf-3e44-44d4-81d9-edc6144f8049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:54.511311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdaaaf-3e44-44d4-81d9-edc6144f8049 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:54.511696 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdaaaf-3e44-44d4-81d9-edc6144f8049 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:54.512040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdaaaf-3e44-44d4-81d9-edc6144f8049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:54.514656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b5fdaaaf-3e44-44d4-81d9-edc6144f8049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:54.577671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db497dfd-5ff0-4db9-bdd7-1cc1bf1eaa42 service swift] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:54.579576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-db497dfd-5ff0-4db9-bdd7-1cc1bf1eaa42 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:54.636821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdaaaf-3e44-44d4-81d9-edc6144f8049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:54.681845 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db497dfd-5ff0-4db9-bdd7-1cc1bf1eaa42 service swift] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:54.689040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:54.690375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:54.690857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:54.691342 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] PATH_INFO: `/v3/users/f642c76a379d43fe97078fb43b7477dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:54.693441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f642c76a379d43fe97078fb43b7477dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:54.722113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdaaaf-3e44-44d4-81d9-edc6144f8049 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:54.748017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:54.759062 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1181/2371] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:54 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:42:54.860826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f642c76a379d43fe97078fb43b7477dc'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:54.879420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f642c76a379d43fe97078fb43b7477dc'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:54.880610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f642c76a379d43fe97078fb43b7477dc'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:54.898533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f642c76a379d43fe97078fb43b7477dc'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:54.934388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ccb7df37-e8ac-4433-bd5d-714745fb919a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f642c76a379d43fe97078fb43b7477dc'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:54.950258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1191/2372] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:42:54 2021] DELETE /identity/v3/users/f642c76a379d43fe97078fb43b7477dc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:42:55.488721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdaaaf-3e44-44d4-81d9-edc6144f8049 service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:55.503162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdaaaf-3e44-44d4-81d9-edc6144f8049 service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:55.646857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:55.648442 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:55.649012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:55.649557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] PATH_INFO: `/v3/projects/755abf4383dc4d3ca3ec465e631d8684` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:55.651878 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=755abf4383dc4d3ca3ec465e631d8684)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:55.718887 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:55.855813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755abf4383dc4d3ca3ec465e631d8684', 'request_id': 'req-70355826-8038-4931-a491-f830ce6cc1ad'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.883611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755abf4383dc4d3ca3ec465e631d8684', 'request_id': 'req-70355826-8038-4931-a491-f830ce6cc1ad'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.905560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755abf4383dc4d3ca3ec465e631d8684', 'request_id': 'req-70355826-8038-4931-a491-f830ce6cc1ad'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.925965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] The token cache is being invalidate because project 755abf4383dc4d3ca3ec465e631d8684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:42:55.926304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.927198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-70355826-8038-4931-a491-f830ce6cc1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:42:55.929589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1182/2373] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:42:55 2021] DELETE /identity/v3/projects/755abf4383dc4d3ca3ec465e631d8684 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:42:55.939819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1edb7-c05d-4a17-8dcb-844a3206cd82 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:55.940674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1edb7-c05d-4a17-8dcb-844a3206cd82 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:55.940837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1edb7-c05d-4a17-8dcb-844a3206cd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:55.979090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-fab1edb7-c05d-4a17-8dcb-844a3206cd82 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:55.980981 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-fab1edb7-c05d-4a17-8dcb-844a3206cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:56.209387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1192/2374] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:56.211025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9515b-ce9a-42a8-9ac0-7576f40a5591 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.211583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9515b-ce9a-42a8-9ac0-7576f40a5591 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.212009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9515b-ce9a-42a8-9ac0-7576f40a5591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.241675 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1fb9515b-ce9a-42a8-9ac0-7576f40a5591 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:56.243190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1fb9515b-ce9a-42a8-9ac0-7576f40a5591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:56.255708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1183/2375] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:56.262141 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1edb7-c05d-4a17-8dcb-844a3206cd82 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.278040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1edb7-c05d-4a17-8dcb-844a3206cd82 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.286025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22966cd-a6d6-4ec1-b62a-838b6f7cdf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.287227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22966cd-a6d6-4ec1-b62a-838b6f7cdf39 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.287723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22966cd-a6d6-4ec1-b62a-838b6f7cdf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.288234 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22966cd-a6d6-4ec1-b62a-838b6f7cdf39 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.289650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22966cd-a6d6-4ec1-b62a-838b6f7cdf39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:42:56.290215 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22966cd-a6d6-4ec1-b62a-838b6f7cdf39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:56.346123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22966cd-a6d6-4ec1-b62a-838b6f7cdf39 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.382091 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1193/2376] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:42:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:42:56.383671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9515b-ce9a-42a8-9ac0-7576f40a5591 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.400670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9515b-ce9a-42a8-9ac0-7576f40a5591 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.409058 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9dd0-b458-433e-8c3e-e275dcb0e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.409948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9dd0-b458-433e-8c3e-e275dcb0e3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.410717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9dd0-b458-433e-8c3e-e275dcb0e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.411217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9dd0-b458-433e-8c3e-e275dcb0e3d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.412749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff9dd0-b458-433e-8c3e-e275dcb0e3d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:56.453386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff9dd0-b458-433e-8c3e-e275dcb0e3d2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.511221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1184/2377] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:42:56 2021] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:42:56.518180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22966cd-a6d6-4ec1-b62a-838b6f7cdf39 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.536236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22966cd-a6d6-4ec1-b62a-838b6f7cdf39 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.636545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb443d06-e6d9-40df-96f0-9624a23c76e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.637616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb443d06-e6d9-40df-96f0-9624a23c76e8 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.638733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb443d06-e6d9-40df-96f0-9624a23c76e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.639315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb443d06-e6d9-40df-96f0-9624a23c76e8 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.640416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb443d06-e6d9-40df-96f0-9624a23c76e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:56.694533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb443d06-e6d9-40df-96f0-9624a23c76e8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.729348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1194/2378] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:42:56 2021] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:42:56.734810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9dd0-b458-433e-8c3e-e275dcb0e3d2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.750367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9dd0-b458-433e-8c3e-e275dcb0e3d2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.756687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b43d26-0ef3-40d4-81eb-f76262c3de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.757386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b43d26-0ef3-40d4-81eb-f76262c3de7a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.757668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b43d26-0ef3-40d4-81eb-f76262c3de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.757942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b43d26-0ef3-40d4-81eb-f76262c3de7a admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.758715 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b43d26-0ef3-40d4-81eb-f76262c3de7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:56.785479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b43d26-0ef3-40d4-81eb-f76262c3de7a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.800206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1185/2379] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:42:56 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:42:56.805349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb443d06-e6d9-40df-96f0-9624a23c76e8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:56.817370 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb443d06-e6d9-40df-96f0-9624a23c76e8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:56.822229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f0b07-af69-4ef9-a5b6-c7afde09ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:56.823165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f0b07-af69-4ef9-a5b6-c7afde09ea6f admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.823504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f0b07-af69-4ef9-a5b6-c7afde09ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.823848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f0b07-af69-4ef9-a5b6-c7afde09ea6f admin admin] PATH_INFO: `/v3/projects/b1eaa5e490594491bd701932cf0d2222/users/727f832d25ef4ac4bff2ae504d84eb75/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:56.860315 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f0b07-af69-4ef9-a5b6-c7afde09ea6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1eaa5e490594491bd701932cf0d2222, user_id=727f832d25ef4ac4bff2ae504d84eb75, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:56.893399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f0b07-af69-4ef9-a5b6-c7afde09ea6f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:56.915978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1195/2380] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:42:56 2021] PUT /identity/v3/projects/b1eaa5e490594491bd701932cf0d2222/users/727f832d25ef4ac4bff2ae504d84eb75/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:42:56.936309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d40109-5eff-4952-b079-2a297c8f218e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:56.936810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d40109-5eff-4952-b079-2a297c8f218e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:56.937328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d40109-5eff-4952-b079-2a297c8f218e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:57.010623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b1d40109-5eff-4952-b079-2a297c8f218e None None] MFA Rules not processed for user `727f832d25ef4ac4bff2ae504d84eb75`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:42:57.012817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b1d40109-5eff-4952-b079-2a297c8f218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:57.149105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1186/2381] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:42:56 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:42:57.169979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f0b07-af69-4ef9-a5b6-c7afde09ea6f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:42:57.178201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-937f0b07-af69-4ef9-a5b6-c7afde09ea6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:42:57.421487 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f0b07-af69-4ef9-a5b6-c7afde09ea6f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:42:57.431581 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54288bba-8cbb-4c54-a1b5-3c89aac97bc0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b797c99041b4e9c9cde7d0064013fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:42:57.432624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54288bba-8cbb-4c54-a1b5-3c89aac97bc0 service glance] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:42:57.433116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54288bba-8cbb-4c54-a1b5-3c89aac97bc0 service glance] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:42:57.434138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54288bba-8cbb-4c54-a1b5-3c89aac97bc0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:42:57.447252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54288bba-8cbb-4c54-a1b5-3c89aac97bc0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:42:57.476327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54288bba-8cbb-4c54-a1b5-3c89aac97bc0 service glance] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:42:57.489079 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1196/2382] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:42:57 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:43:00.462746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d40109-5eff-4952-b079-2a297c8f218e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:00.465267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b1d40109-5eff-4952-b079-2a297c8f218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:00.582426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d40109-5eff-4952-b079-2a297c8f218e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:00.588386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:00.589418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:00.590109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:00.590513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:00.593908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:00.615730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:00.684906 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:00.708419 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1187/2383] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:00 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:43:21.619695 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54288bba-8cbb-4c54-a1b5-3c89aac97bc0 service glance] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:21.621147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-54288bba-8cbb-4c54-a1b5-3c89aac97bc0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:21.753502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54288bba-8cbb-4c54-a1b5-3c89aac97bc0 service glance] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:21.761322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c62a5-b259-45b7-b771-4bb047067ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:21.762556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c62a5-b259-45b7-b771-4bb047067ddb service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:21.763055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c62a5-b259-45b7-b771-4bb047067ddb service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:21.763494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c62a5-b259-45b7-b771-4bb047067ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:21.766388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-385c62a5-b259-45b7-b771-4bb047067ddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:21.859432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c62a5-b259-45b7-b771-4bb047067ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:21.890968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c62a5-b259-45b7-b771-4bb047067ddb service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:21.901219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1197/2384] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:21 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:34.178242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:34.180300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:34.299912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bd887-58eb-4bb7-aaf3-941d06e8020f service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:34.313575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:34.315028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:34.315515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:34.316015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] PATH_INFO: `/v3/users/f8c9d652402e4465b4820436357bdc72` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:34.318255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c9d652402e4465b4820436357bdc72)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:34.373872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:34.512127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c9d652402e4465b4820436357bdc72'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:34.537085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c9d652402e4465b4820436357bdc72'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:34.554772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c9d652402e4465b4820436357bdc72'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:34.555977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c9d652402e4465b4820436357bdc72'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:34.572362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e87d02db-35b6-4318-b07a-c0ccec19d838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c9d652402e4465b4820436357bdc72'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:34.580822 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1188/2385] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:34 2021] DELETE /identity/v3/users/f8c9d652402e4465b4820436357bdc72 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:34.863811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c62a5-b259-45b7-b771-4bb047067ddb service nova] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:34.875913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c62a5-b259-45b7-b771-4bb047067ddb service nova] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:34.957853 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:34.958966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:34.959367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:34.959708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] PATH_INFO: `/v3/projects/c2109a7078ee45b1b922e81c997328cb` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:34.961050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2109a7078ee45b1b922e81c997328cb)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:34.988337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:35.196267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2109a7078ee45b1b922e81c997328cb', 'request_id': 'req-b9e782fa-271f-4121-a8bc-f9778e17e13f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:35.211459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2109a7078ee45b1b922e81c997328cb', 'request_id': 'req-b9e782fa-271f-4121-a8bc-f9778e17e13f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:35.222800 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2109a7078ee45b1b922e81c997328cb', 'request_id': 'req-b9e782fa-271f-4121-a8bc-f9778e17e13f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:35.236484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] The token cache is being invalidate because project c2109a7078ee45b1b922e81c997328cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:35.236798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:35.237709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b9e782fa-271f-4121-a8bc-f9778e17e13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:35.239416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1198/2386] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:34 2021] DELETE /identity/v3/projects/c2109a7078ee45b1b922e81c997328cb => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:35.247126 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485a23c-6ecf-49fa-baf5-f675beffa7a8 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:35.247888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485a23c-6ecf-49fa-baf5-f675beffa7a8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:35.248761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485a23c-6ecf-49fa-baf5-f675beffa7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:35.279666 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d485a23c-6ecf-49fa-baf5-f675beffa7a8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:35.281369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d485a23c-6ecf-49fa-baf5-f675beffa7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:35.387308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1189/2387] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:35.396936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af78e0d-38dd-4002-b07c-a2bd50067c63 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:35.397279 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af78e0d-38dd-4002-b07c-a2bd50067c63 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:35.397604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af78e0d-38dd-4002-b07c-a2bd50067c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:35.433268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-7af78e0d-38dd-4002-b07c-a2bd50067c63 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:35.434581 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7af78e0d-38dd-4002-b07c-a2bd50067c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:35.442730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1199/2388] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:35.449398 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485a23c-6ecf-49fa-baf5-f675beffa7a8 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:35.469260 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485a23c-6ecf-49fa-baf5-f675beffa7a8 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:35.476701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2e926-6c86-4dae-acde-1155c5101ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:35.477721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2e926-6c86-4dae-acde-1155c5101ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:35.478265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2e926-6c86-4dae-acde-1155c5101ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:35.478762 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2e926-6c86-4dae-acde-1155c5101ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:35.480014 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2e926-6c86-4dae-acde-1155c5101ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:43:35.480513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2e926-6c86-4dae-acde-1155c5101ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:35.535584 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2e926-6c86-4dae-acde-1155c5101ee4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:35.559432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1190/2389] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:43:35.566473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af78e0d-38dd-4002-b07c-a2bd50067c63 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:35.578926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af78e0d-38dd-4002-b07c-a2bd50067c63 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:35.584397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e234f-adc6-4e07-9423-3e1f3fc23570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:35.585245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e234f-adc6-4e07-9423-3e1f3fc23570 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:35.585624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e234f-adc6-4e07-9423-3e1f3fc23570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:35.586014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e234f-adc6-4e07-9423-3e1f3fc23570 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:35.586841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e234f-adc6-4e07-9423-3e1f3fc23570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:35.632799 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e234f-adc6-4e07-9423-3e1f3fc23570 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:35.690247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2e926-6c86-4dae-acde-1155c5101ee4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:35.694120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1200/2390] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:35 2021] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:35.708480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2e926-6c86-4dae-acde-1155c5101ee4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:35.831635 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e636f97-76fb-43d8-a364-d864bb880156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:35.832382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e636f97-76fb-43d8-a364-d864bb880156 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:35.832738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e636f97-76fb-43d8-a364-d864bb880156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:35.833079 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e636f97-76fb-43d8-a364-d864bb880156 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:35.833827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e636f97-76fb-43d8-a364-d864bb880156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:35.861951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e636f97-76fb-43d8-a364-d864bb880156 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:35.888476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1191/2391] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:35 2021] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:35.894457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e234f-adc6-4e07-9423-3e1f3fc23570 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:35.912965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e234f-adc6-4e07-9423-3e1f3fc23570 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:35.921051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906e56d-01f2-4add-9311-f3356545a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:35.922233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906e56d-01f2-4add-9311-f3356545a6fd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:35.922872 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906e56d-01f2-4add-9311-f3356545a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:35.923604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906e56d-01f2-4add-9311-f3356545a6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:35.925057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906e56d-01f2-4add-9311-f3356545a6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:35.960104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906e56d-01f2-4add-9311-f3356545a6fd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:35.973039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1201/2392] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:35 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:35.978404 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e636f97-76fb-43d8-a364-d864bb880156 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:35.994469 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e636f97-76fb-43d8-a364-d864bb880156 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:36.001691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfbb4b-d54f-45f8-8114-389be0e48e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:36.003272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfbb4b-d54f-45f8-8114-389be0e48e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:36.003737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfbb4b-d54f-45f8-8114-389be0e48e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:36.004251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfbb4b-d54f-45f8-8114-389be0e48e3d admin admin] PATH_INFO: `/v3/projects/892aa4dff52e48e39a688fc1f73da57e/users/97285739f27345b39a0a48a08322e54a/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:36.048764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfbb4b-d54f-45f8-8114-389be0e48e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=892aa4dff52e48e39a688fc1f73da57e, user_id=97285739f27345b39a0a48a08322e54a, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:36.090711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfbb4b-d54f-45f8-8114-389be0e48e3d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:36.112717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1192/2393] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:35 2021] PUT /identity/v3/projects/892aa4dff52e48e39a688fc1f73da57e/users/97285739f27345b39a0a48a08322e54a/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:36.129480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7433-79fb-4815-a856-909d9abfb742 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:36.129861 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7433-79fb-4815-a856-909d9abfb742 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:36.130294 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7433-79fb-4815-a856-909d9abfb742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:36.179124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-dd7e7433-79fb-4815-a856-909d9abfb742 None None] MFA Rules not processed for user `97285739f27345b39a0a48a08322e54a`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:36.180960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-dd7e7433-79fb-4815-a856-909d9abfb742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:36.287312 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1202/2394] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:36 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:36.294142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfbb4b-d54f-45f8-8114-389be0e48e3d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:36.393974 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfbb4b-d54f-45f8-8114-389be0e48e3d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:36.401047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cffd2-0af4-4338-a617-5a4e5dd85439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:36.401965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cffd2-0af4-4338-a617-5a4e5dd85439 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:36.402444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cffd2-0af4-4338-a617-5a4e5dd85439 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:36.402870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cffd2-0af4-4338-a617-5a4e5dd85439 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:36.403915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cffd2-0af4-4338-a617-5a4e5dd85439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:36.450304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cffd2-0af4-4338-a617-5a4e5dd85439 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:36.501905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1193/2395] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:36 2021] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:36.505092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e7433-79fb-4815-a856-909d9abfb742 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:36.519738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e7433-79fb-4815-a856-909d9abfb742 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:36.604856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10bc5d-939b-4fa6-83cd-531e802737a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:36.605607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10bc5d-939b-4fa6-83cd-531e802737a0 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:36.605950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10bc5d-939b-4fa6-83cd-531e802737a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:36.606385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10bc5d-939b-4fa6-83cd-531e802737a0 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:36.607114 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10bc5d-939b-4fa6-83cd-531e802737a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:36.634447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10bc5d-939b-4fa6-83cd-531e802737a0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:36.671429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1203/2396] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:36 2021] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:36.674122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cffd2-0af4-4338-a617-5a4e5dd85439 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:36.692538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cffd2-0af4-4338-a617-5a4e5dd85439 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:36.700276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03b9b4-3aeb-4743-a3b6-2e40b7ccd658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:36.701334 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03b9b4-3aeb-4743-a3b6-2e40b7ccd658 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:36.701856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03b9b4-3aeb-4743-a3b6-2e40b7ccd658 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:36.702411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03b9b4-3aeb-4743-a3b6-2e40b7ccd658 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:36.704239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03b9b4-3aeb-4743-a3b6-2e40b7ccd658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:36.760413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03b9b4-3aeb-4743-a3b6-2e40b7ccd658 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:36.787101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1194/2397] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:36 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:36.791482 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10bc5d-939b-4fa6-83cd-531e802737a0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:36.804470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10bc5d-939b-4fa6-83cd-531e802737a0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:36.811803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b67b7-4451-4a69-a957-16582de7464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:36.813522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b67b7-4451-4a69-a957-16582de7464e admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:36.814160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b67b7-4451-4a69-a957-16582de7464e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:36.814681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b67b7-4451-4a69-a957-16582de7464e admin admin] PATH_INFO: `/v3/projects/163569c51c1c40bdbc1409998b5dfa1d/users/9ae34cd7a4134cb9bd4a0bfc0644f525/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:36.859144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b67b7-4451-4a69-a957-16582de7464e admin admin] RBAC: Authorizing `identity:create_grant(project_id=163569c51c1c40bdbc1409998b5dfa1d, user_id=9ae34cd7a4134cb9bd4a0bfc0644f525, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:36.917856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b67b7-4451-4a69-a957-16582de7464e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:36.936426 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1204/2398] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:36 2021] PUT /identity/v3/projects/163569c51c1c40bdbc1409998b5dfa1d/users/9ae34cd7a4134cb9bd4a0bfc0644f525/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:36.941421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03b9b4-3aeb-4743-a3b6-2e40b7ccd658 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:36.952110 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03b9b4-3aeb-4743-a3b6-2e40b7ccd658 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:37.068624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2a9a-d41a-4bc2-9b47-58280964e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:37.069236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2a9a-d41a-4bc2-9b47-58280964e8ce admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:37.069567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2a9a-d41a-4bc2-9b47-58280964e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:37.070460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2a9a-d41a-4bc2-9b47-58280964e8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:37.071706 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2a9a-d41a-4bc2-9b47-58280964e8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:37.098341 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2a9a-d41a-4bc2-9b47-58280964e8ce admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:37.116495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1195/2399] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:36 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:37.117721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b67b7-4451-4a69-a957-16582de7464e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:37.130284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b67b7-4451-4a69-a957-16582de7464e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:37.136882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18bf61-5401-4fa9-9c91-c13167a4799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:37.138096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18bf61-5401-4fa9-9c91-c13167a4799f admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:37.138603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18bf61-5401-4fa9-9c91-c13167a4799f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:37.139071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18bf61-5401-4fa9-9c91-c13167a4799f admin admin] PATH_INFO: `/v3/projects/163569c51c1c40bdbc1409998b5dfa1d/users/9ae34cd7a4134cb9bd4a0bfc0644f525/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:37.141437 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18bf61-5401-4fa9-9c91-c13167a4799f admin admin] RBAC: Authorizing `identity:create_grant(project_id=163569c51c1c40bdbc1409998b5dfa1d, user_id=9ae34cd7a4134cb9bd4a0bfc0644f525, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:37.170977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18bf61-5401-4fa9-9c91-c13167a4799f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:37.182794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1205/2400] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:37 2021] PUT /identity/v3/projects/163569c51c1c40bdbc1409998b5dfa1d/users/9ae34cd7a4134cb9bd4a0bfc0644f525/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:37.187313 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2a9a-d41a-4bc2-9b47-58280964e8ce admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:37.198266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2a9a-d41a-4bc2-9b47-58280964e8ce admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:37.279141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1792de4-fc8d-43cb-bcbf-640df4ecb589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:37.279931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1792de4-fc8d-43cb-bcbf-640df4ecb589 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:37.280280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1792de4-fc8d-43cb-bcbf-640df4ecb589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:37.280687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1792de4-fc8d-43cb-bcbf-640df4ecb589 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:37.281551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1792de4-fc8d-43cb-bcbf-640df4ecb589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:37.308381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1792de4-fc8d-43cb-bcbf-640df4ecb589 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:37.321857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1196/2401] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:37 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:37.327756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18bf61-5401-4fa9-9c91-c13167a4799f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:37.341875 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18bf61-5401-4fa9-9c91-c13167a4799f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:37.348157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620b65-065c-49b5-b72d-b79664c6be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:37.349309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620b65-065c-49b5-b72d-b79664c6be50 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:37.349675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620b65-065c-49b5-b72d-b79664c6be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:37.350255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620b65-065c-49b5-b72d-b79664c6be50 admin admin] PATH_INFO: `/v3/projects/163569c51c1c40bdbc1409998b5dfa1d/users/9ae34cd7a4134cb9bd4a0bfc0644f525/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:37.352626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95620b65-065c-49b5-b72d-b79664c6be50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163569c51c1c40bdbc1409998b5dfa1d, user_id=9ae34cd7a4134cb9bd4a0bfc0644f525, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:37.391351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95620b65-065c-49b5-b72d-b79664c6be50 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:37.415895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1206/2402] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:37 2021] PUT /identity/v3/projects/163569c51c1c40bdbc1409998b5dfa1d/users/9ae34cd7a4134cb9bd4a0bfc0644f525/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:37.430604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da24916-55dd-411b-a199-cded6c80b054 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:37.431088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da24916-55dd-411b-a199-cded6c80b054 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:37.432090 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da24916-55dd-411b-a199-cded6c80b054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:37.497817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-9da24916-55dd-411b-a199-cded6c80b054 None None] MFA Rules not processed for user `9ae34cd7a4134cb9bd4a0bfc0644f525`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:37.500107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9da24916-55dd-411b-a199-cded6c80b054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:37.643601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1197/2403] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:37 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:37.655500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620b65-065c-49b5-b72d-b79664c6be50 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:37.658209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-95620b65-065c-49b5-b72d-b79664c6be50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:37.762530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620b65-065c-49b5-b72d-b79664c6be50 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:37.768057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a5e54-5d51-45f2-933a-956bc4f96860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:37.769091 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a5e54-5d51-45f2-933a-956bc4f96860 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:37.769385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a5e54-5d51-45f2-933a-956bc4f96860 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:37.769720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a5e54-5d51-45f2-933a-956bc4f96860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:37.787515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a5e54-5d51-45f2-933a-956bc4f96860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:37.849974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a5e54-5d51-45f2-933a-956bc4f96860 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:37.873894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1207/2404] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:37 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:38.298190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da24916-55dd-411b-a199-cded6c80b054 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:38.390543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da24916-55dd-411b-a199-cded6c80b054 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:38.395271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:38.396173 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:38.396483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:38.396782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] PATH_INFO: `/v3/users/97285739f27345b39a0a48a08322e54a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:38.398016 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97285739f27345b39a0a48a08322e54a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:38.424533 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:38.494253 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97285739f27345b39a0a48a08322e54a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:38.509536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97285739f27345b39a0a48a08322e54a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:38.520095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97285739f27345b39a0a48a08322e54a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:38.521219 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97285739f27345b39a0a48a08322e54a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:38.533290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97285739f27345b39a0a48a08322e54a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:38.541805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1198/2405] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:38 2021] DELETE /identity/v3/users/97285739f27345b39a0a48a08322e54a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:38.548889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42a03d-551e-41e2-b4fe-43c54fdc39fb None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:38.549533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42a03d-551e-41e2-b4fe-43c54fdc39fb None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:38.550090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42a03d-551e-41e2-b4fe-43c54fdc39fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:38.594271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-ff42a03d-551e-41e2-b4fe-43c54fdc39fb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:38.597122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ff42a03d-551e-41e2-b4fe-43c54fdc39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:38.714084 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1208/2406] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:38.726446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:38.728195 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:38.829123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76ea2-d4d6-41e1-83d5-245a717d5125 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:38.833525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c5b4d-2f43-4bb9-a0bd-48e04cb6dff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:38.834270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c5b4d-2f43-4bb9-a0bd-48e04cb6dff5 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:38.834611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c5b4d-2f43-4bb9-a0bd-48e04cb6dff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:38.834939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c5b4d-2f43-4bb9-a0bd-48e04cb6dff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:38.846568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c5b4d-2f43-4bb9-a0bd-48e04cb6dff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:38.873001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c5b4d-2f43-4bb9-a0bd-48e04cb6dff5 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:38.884311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1199/2407] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:39.350976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42a03d-551e-41e2-b4fe-43c54fdc39fb None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:39.352902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ff42a03d-551e-41e2-b4fe-43c54fdc39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:39.376025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42a03d-551e-41e2-b4fe-43c54fdc39fb None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:39.381982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:39.383029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:39.383423 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:39.383810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] PATH_INFO: `/v3/projects/892aa4dff52e48e39a688fc1f73da57e` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:39.385308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=892aa4dff52e48e39a688fc1f73da57e)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:39.412203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:39.494119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892aa4dff52e48e39a688fc1f73da57e', 'request_id': 'req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.507604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892aa4dff52e48e39a688fc1f73da57e', 'request_id': 'req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.517273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892aa4dff52e48e39a688fc1f73da57e', 'request_id': 'req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.534656 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] The token cache is being invalidate because project 892aa4dff52e48e39a688fc1f73da57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:39.535146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.536201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.538785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1209/2408] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:39 2021] DELETE /identity/v3/projects/892aa4dff52e48e39a688fc1f73da57e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:39.545637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c5b4d-2f43-4bb9-a0bd-48e04cb6dff5 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:39.564598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c5b4d-2f43-4bb9-a0bd-48e04cb6dff5 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:39.677413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:39.678462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:39.678761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:39.679115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] PATH_INFO: `/v3/users/9ae34cd7a4134cb9bd4a0bfc0644f525` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:39.680598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae34cd7a4134cb9bd4a0bfc0644f525)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:39.714451 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:39.796330 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae34cd7a4134cb9bd4a0bfc0644f525'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.815707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae34cd7a4134cb9bd4a0bfc0644f525'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.826771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae34cd7a4134cb9bd4a0bfc0644f525'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.827634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae34cd7a4134cb9bd4a0bfc0644f525'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.840081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-fa90b0f2-dd66-45dd-91e1-b8c9f0b99f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae34cd7a4134cb9bd4a0bfc0644f525'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:39.852685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1200/2409] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:39 2021] DELETE /identity/v3/users/9ae34cd7a4134cb9bd4a0bfc0644f525 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:40.596548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:40.598579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:40.619387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3057f5-d7cb-46fa-b8fe-982ed597d18e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:40.703093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:40.704645 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:40.705293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:40.705758 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] PATH_INFO: `/v3/projects/163569c51c1c40bdbc1409998b5dfa1d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:40.708295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=163569c51c1c40bdbc1409998b5dfa1d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:40.767547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:40.838907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163569c51c1c40bdbc1409998b5dfa1d', 'request_id': 'req-43123117-63e1-4b07-b80e-58ae0339e92b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:40.853492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163569c51c1c40bdbc1409998b5dfa1d', 'request_id': 'req-43123117-63e1-4b07-b80e-58ae0339e92b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:40.864276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163569c51c1c40bdbc1409998b5dfa1d', 'request_id': 'req-43123117-63e1-4b07-b80e-58ae0339e92b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:40.887541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] The token cache is being invalidate because project 163569c51c1c40bdbc1409998b5dfa1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:40.888048 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:40.888990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-43123117-63e1-4b07-b80e-58ae0339e92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:40.891222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1210/2410] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:40 2021] DELETE /identity/v3/projects/163569c51c1c40bdbc1409998b5dfa1d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:40.900493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd899d4-9ce8-4056-8c62-c3b9b83747b6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:40.901244 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd899d4-9ce8-4056-8c62-c3b9b83747b6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:40.901530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd899d4-9ce8-4056-8c62-c3b9b83747b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:40.943043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6cd899d4-9ce8-4056-8c62-c3b9b83747b6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:40.945109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6cd899d4-9ce8-4056-8c62-c3b9b83747b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:41.038970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1201/2411] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:41.047857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ac30-60bd-489a-bcf9-bc2e124bc720 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:41.048203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ac30-60bd-489a-bcf9-bc2e124bc720 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:41.048514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ac30-60bd-489a-bcf9-bc2e124bc720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:41.080424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-02e0ac30-60bd-489a-bcf9-bc2e124bc720 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:41.081727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-02e0ac30-60bd-489a-bcf9-bc2e124bc720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:41.095248 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1211/2412] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:43:41.100848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd899d4-9ce8-4056-8c62-c3b9b83747b6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:41.115067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd899d4-9ce8-4056-8c62-c3b9b83747b6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:41.122920 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca11a-aa37-444a-a1e6-074890fb3b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:41.123957 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca11a-aa37-444a-a1e6-074890fb3b06 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:41.124467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca11a-aa37-444a-a1e6-074890fb3b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:41.124943 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca11a-aa37-444a-a1e6-074890fb3b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:41.126415 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca11a-aa37-444a-a1e6-074890fb3b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:43:41.126929 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca11a-aa37-444a-a1e6-074890fb3b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:41.176277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca11a-aa37-444a-a1e6-074890fb3b06 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:41.200444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1202/2413] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:43:41.205328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0ac30-60bd-489a-bcf9-bc2e124bc720 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:41.215421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0ac30-60bd-489a-bcf9-bc2e124bc720 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:41.221104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc377a6-aaa1-4f5a-852e-0817533cff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:41.221730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc377a6-aaa1-4f5a-852e-0817533cff7d admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:41.222041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc377a6-aaa1-4f5a-852e-0817533cff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:41.222332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc377a6-aaa1-4f5a-852e-0817533cff7d admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:41.223004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc377a6-aaa1-4f5a-852e-0817533cff7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:41.251111 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc377a6-aaa1-4f5a-852e-0817533cff7d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:41.284172 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1212/2414] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:41 2021] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:41.288913 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca11a-aa37-444a-a1e6-074890fb3b06 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:41.301229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca11a-aa37-444a-a1e6-074890fb3b06 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:41.428459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb3287-a063-42c7-ba87-4368d67ac0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:41.429238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb3287-a063-42c7-ba87-4368d67ac0ad admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:41.429657 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb3287-a063-42c7-ba87-4368d67ac0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:41.430096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb3287-a063-42c7-ba87-4368d67ac0ad admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:41.431187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb3287-a063-42c7-ba87-4368d67ac0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:41.479760 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb3287-a063-42c7-ba87-4368d67ac0ad admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:41.511655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1203/2415] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:41 2021] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:41.513003 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc377a6-aaa1-4f5a-852e-0817533cff7d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:41.526911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc377a6-aaa1-4f5a-852e-0817533cff7d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:41.533630 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61315a1-603f-4473-b037-b63c7f83e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:41.534640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61315a1-603f-4473-b037-b63c7f83e156 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:41.535093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61315a1-603f-4473-b037-b63c7f83e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:41.535569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61315a1-603f-4473-b037-b63c7f83e156 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:41.536647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61315a1-603f-4473-b037-b63c7f83e156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:41.572071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61315a1-603f-4473-b037-b63c7f83e156 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:41.587094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1213/2416] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:41 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:41.592336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb3287-a063-42c7-ba87-4368d67ac0ad admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:41.607288 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb3287-a063-42c7-ba87-4368d67ac0ad admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:41.615801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71958821-ddfd-4c78-9da9-e48bafcc8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:41.617064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958821-ddfd-4c78-9da9-e48bafcc8ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:41.617488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958821-ddfd-4c78-9da9-e48bafcc8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:41.618119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958821-ddfd-4c78-9da9-e48bafcc8ec3 admin admin] PATH_INFO: `/v3/projects/720ee207868d486fb07b39b3e858438f/users/313671f5116c49e8bb71bacf3ab810ab/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:41.656287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71958821-ddfd-4c78-9da9-e48bafcc8ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720ee207868d486fb07b39b3e858438f, user_id=313671f5116c49e8bb71bacf3ab810ab, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:41.704899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71958821-ddfd-4c78-9da9-e48bafcc8ec3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:41.735018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1204/2417] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:41 2021] PUT /identity/v3/projects/720ee207868d486fb07b39b3e858438f/users/313671f5116c49e8bb71bacf3ab810ab/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:41.743816 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f550-e851-4546-99dc-2e7f996439b5 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:41.744503 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f550-e851-4546-99dc-2e7f996439b5 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:41.744959 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f550-e851-4546-99dc-2e7f996439b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:41.809352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-31d9f550-e851-4546-99dc-2e7f996439b5 None None] MFA Rules not processed for user `313671f5116c49e8bb71bacf3ab810ab`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:41.810712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-31d9f550-e851-4546-99dc-2e7f996439b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:41.917352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1214/2418] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:41 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:41.922509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71958821-ddfd-4c78-9da9-e48bafcc8ec3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:42.056922 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71958821-ddfd-4c78-9da9-e48bafcc8ec3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:42.065616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e27b1-e26e-4135-988e-2e6126b59697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:42.067417 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e27b1-e26e-4135-988e-2e6126b59697 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:42.067417 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e27b1-e26e-4135-988e-2e6126b59697 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:42.067778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e27b1-e26e-4135-988e-2e6126b59697 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:42.069052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e27b1-e26e-4135-988e-2e6126b59697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:42.114793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e27b1-e26e-4135-988e-2e6126b59697 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:42.165433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1205/2419] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:41 2021] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:42.166741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f550-e851-4546-99dc-2e7f996439b5 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:42.191227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f550-e851-4546-99dc-2e7f996439b5 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:42.296180 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c189d-5358-4138-91d5-54f399cdccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:42.296813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c189d-5358-4138-91d5-54f399cdccf0 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:42.297112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c189d-5358-4138-91d5-54f399cdccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:42.297400 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c189d-5358-4138-91d5-54f399cdccf0 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:42.298170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c189d-5358-4138-91d5-54f399cdccf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:42.325698 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c189d-5358-4138-91d5-54f399cdccf0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:42.348761 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1215/2420] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:42 2021] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:42.353236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e27b1-e26e-4135-988e-2e6126b59697 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:42.371228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e27b1-e26e-4135-988e-2e6126b59697 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:42.378444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999b484-cdd2-4366-9f7f-75eb156ae6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:42.379511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999b484-cdd2-4366-9f7f-75eb156ae6bb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:42.379951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999b484-cdd2-4366-9f7f-75eb156ae6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:42.380383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999b484-cdd2-4366-9f7f-75eb156ae6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:42.381526 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999b484-cdd2-4366-9f7f-75eb156ae6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:42.427350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999b484-cdd2-4366-9f7f-75eb156ae6bb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:42.454460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1206/2421] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:42 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:42.458710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c189d-5358-4138-91d5-54f399cdccf0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:42.478249 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c189d-5358-4138-91d5-54f399cdccf0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:42.490601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635cf61-b5da-42df-8bed-d815d69c9080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:42.492704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635cf61-b5da-42df-8bed-d815d69c9080 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:42.493280 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635cf61-b5da-42df-8bed-d815d69c9080 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:42.493805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635cf61-b5da-42df-8bed-d815d69c9080 admin admin] PATH_INFO: `/v3/projects/87d21b6018d9401e94877cb0d3de109a/users/3f59f4231bf24bdf9cb04b9ecf2220ab/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:42.522641 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635cf61-b5da-42df-8bed-d815d69c9080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d21b6018d9401e94877cb0d3de109a, user_id=3f59f4231bf24bdf9cb04b9ecf2220ab, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:42.557473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635cf61-b5da-42df-8bed-d815d69c9080 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:42.577284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1216/2422] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:42 2021] PUT /identity/v3/projects/87d21b6018d9401e94877cb0d3de109a/users/3f59f4231bf24bdf9cb04b9ecf2220ab/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:42.582199 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999b484-cdd2-4366-9f7f-75eb156ae6bb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:42.594511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999b484-cdd2-4366-9f7f-75eb156ae6bb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:42.719007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b9ad-99dd-4fe2-9506-98fdcc63778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:42.720321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b9ad-99dd-4fe2-9506-98fdcc63778a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:42.721092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b9ad-99dd-4fe2-9506-98fdcc63778a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:42.721840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b9ad-99dd-4fe2-9506-98fdcc63778a admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:42.723305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9b9ad-99dd-4fe2-9506-98fdcc63778a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:42.783018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9b9ad-99dd-4fe2-9506-98fdcc63778a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:42.812441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1207/2423] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:42 2021] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:42.819293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635cf61-b5da-42df-8bed-d815d69c9080 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:42.835896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635cf61-b5da-42df-8bed-d815d69c9080 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:42.842736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f098b34-4031-4353-8775-1195ea8ca7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:42.843671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f098b34-4031-4353-8775-1195ea8ca7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:42.843965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f098b34-4031-4353-8775-1195ea8ca7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:42.844252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f098b34-4031-4353-8775-1195ea8ca7a1 admin admin] PATH_INFO: `/v3/projects/87d21b6018d9401e94877cb0d3de109a/users/3f59f4231bf24bdf9cb04b9ecf2220ab/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:42.846907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f098b34-4031-4353-8775-1195ea8ca7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d21b6018d9401e94877cb0d3de109a, user_id=3f59f4231bf24bdf9cb04b9ecf2220ab, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:42.882063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f098b34-4031-4353-8775-1195ea8ca7a1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:42.899849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1217/2424] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:42 2021] PUT /identity/v3/projects/87d21b6018d9401e94877cb0d3de109a/users/3f59f4231bf24bdf9cb04b9ecf2220ab/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:42.906163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b9ad-99dd-4fe2-9506-98fdcc63778a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:42.918349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b9ad-99dd-4fe2-9506-98fdcc63778a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:43.011689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba22b84-41e2-43d8-892a-46af9d16fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:43.013019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22b84-41e2-43d8-892a-46af9d16fc34 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:43.013538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22b84-41e2-43d8-892a-46af9d16fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:43.014074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba22b84-41e2-43d8-892a-46af9d16fc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:43.015435 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22b84-41e2-43d8-892a-46af9d16fc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:43.072735 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba22b84-41e2-43d8-892a-46af9d16fc34 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:43.101242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1208/2425] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:42 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:43.103494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f098b34-4031-4353-8775-1195ea8ca7a1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:43.122767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f098b34-4031-4353-8775-1195ea8ca7a1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:43.131870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7ba22-9acd-4032-90a5-dd5fca2e6ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:43.134450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7ba22-9acd-4032-90a5-dd5fca2e6ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:43.134450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7ba22-9acd-4032-90a5-dd5fca2e6ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:43.134751 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7ba22-9acd-4032-90a5-dd5fca2e6ecf admin admin] PATH_INFO: `/v3/projects/87d21b6018d9401e94877cb0d3de109a/users/3f59f4231bf24bdf9cb04b9ecf2220ab/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:43.138167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7ba22-9acd-4032-90a5-dd5fca2e6ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d21b6018d9401e94877cb0d3de109a, user_id=3f59f4231bf24bdf9cb04b9ecf2220ab, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:43.197196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7ba22-9acd-4032-90a5-dd5fca2e6ecf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:43.226200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1218/2426] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:43 2021] PUT /identity/v3/projects/87d21b6018d9401e94877cb0d3de109a/users/3f59f4231bf24bdf9cb04b9ecf2220ab/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:43.240913 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613b2d-9c7b-4374-8737-adac74d6bff1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:43.241153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613b2d-9c7b-4374-8737-adac74d6bff1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:43.241719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613b2d-9c7b-4374-8737-adac74d6bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:43.288041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-00613b2d-9c7b-4374-8737-adac74d6bff1 None None] MFA Rules not processed for user `3f59f4231bf24bdf9cb04b9ecf2220ab`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:43.289512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-00613b2d-9c7b-4374-8737-adac74d6bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:43.497856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1209/2427] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:43 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:43.509110 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7ba22-9acd-4032-90a5-dd5fca2e6ecf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:43.511276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1cc7ba22-9acd-4032-90a5-dd5fca2e6ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:43.615631 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7ba22-9acd-4032-90a5-dd5fca2e6ecf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:43.625550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28500be3-13f7-405a-80fb-85020acb16e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:43.626890 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28500be3-13f7-405a-80fb-85020acb16e6 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:43.627487 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28500be3-13f7-405a-80fb-85020acb16e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:43.628087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28500be3-13f7-405a-80fb-85020acb16e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:43.639021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28500be3-13f7-405a-80fb-85020acb16e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:43.666516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28500be3-13f7-405a-80fb-85020acb16e6 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:43.679123 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1219/2428] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:43 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:43.852591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00613b2d-9c7b-4374-8737-adac74d6bff1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:43.953450 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00613b2d-9c7b-4374-8737-adac74d6bff1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:43.961126 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:43.968970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:43.968970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:43.968970 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] PATH_INFO: `/v3/users/313671f5116c49e8bb71bacf3ab810ab` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:43.970052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313671f5116c49e8bb71bacf3ab810ab)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:44.010385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:44.105677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313671f5116c49e8bb71bacf3ab810ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:44.142133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313671f5116c49e8bb71bacf3ab810ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:44.160035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313671f5116c49e8bb71bacf3ab810ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:44.161152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313671f5116c49e8bb71bacf3ab810ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:44.180366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313671f5116c49e8bb71bacf3ab810ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:44.202105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1210/2429] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:43 2021] DELETE /identity/v3/users/313671f5116c49e8bb71bacf3ab810ab => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:44.209836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d4587-c888-495f-a75d-825da10d6a6e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:44.210786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d4587-c888-495f-a75d-825da10d6a6e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:44.210977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d4587-c888-495f-a75d-825da10d6a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:44.277395 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d78d4587-c888-495f-a75d-825da10d6a6e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:44.280169 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d78d4587-c888-495f-a75d-825da10d6a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:44.464968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1220/2430] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:44.490509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:44.494423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:44.611491 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcbaae-c087-431a-9224-81be02f212a7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:44.615191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0243f3-eed9-4322-9f7a-9a41e7cb1bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:44.615826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0243f3-eed9-4322-9f7a-9a41e7cb1bca service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:44.616131 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0243f3-eed9-4322-9f7a-9a41e7cb1bca service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:44.617284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0243f3-eed9-4322-9f7a-9a41e7cb1bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:44.628966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0243f3-eed9-4322-9f7a-9a41e7cb1bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:44.658107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0243f3-eed9-4322-9f7a-9a41e7cb1bca service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:44.671233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1211/2431] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:43:45.254824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d4587-c888-495f-a75d-825da10d6a6e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:45.256686 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d78d4587-c888-495f-a75d-825da10d6a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:45.270858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d4587-c888-495f-a75d-825da10d6a6e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:45.276548 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:45.277475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:45.277756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:45.278122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] PATH_INFO: `/v3/projects/720ee207868d486fb07b39b3e858438f` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:45.279614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=720ee207868d486fb07b39b3e858438f)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:45.307531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:45.379311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720ee207868d486fb07b39b3e858438f', 'request_id': 'req-cef929a8-9033-451a-b3bd-ea56b2b2ca42'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.393143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720ee207868d486fb07b39b3e858438f', 'request_id': 'req-cef929a8-9033-451a-b3bd-ea56b2b2ca42'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.402362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720ee207868d486fb07b39b3e858438f', 'request_id': 'req-cef929a8-9033-451a-b3bd-ea56b2b2ca42'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.416900 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] The token cache is being invalidate because project 720ee207868d486fb07b39b3e858438f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:45.417281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.417873 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.419508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1221/2432] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:45 2021] DELETE /identity/v3/projects/720ee207868d486fb07b39b3e858438f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:45.425458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0243f3-eed9-4322-9f7a-9a41e7cb1bca service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:45.441180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0243f3-eed9-4322-9f7a-9a41e7cb1bca service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:45.529837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:45.530792 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:45.531116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:45.531434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] PATH_INFO: `/v3/users/3f59f4231bf24bdf9cb04b9ecf2220ab` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:45.533175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f59f4231bf24bdf9cb04b9ecf2220ab)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:45.561347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:45.627987 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f59f4231bf24bdf9cb04b9ecf2220ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.650356 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f59f4231bf24bdf9cb04b9ecf2220ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.659721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f59f4231bf24bdf9cb04b9ecf2220ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.660511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f59f4231bf24bdf9cb04b9ecf2220ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.669397 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-841d9dda-9c62-4a42-91ac-05544681bc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f59f4231bf24bdf9cb04b9ecf2220ab'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:45.679590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1212/2433] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:43:45 2021] DELETE /identity/v3/users/3f59f4231bf24bdf9cb04b9ecf2220ab => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:46.193931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:46.198372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:46.221209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef929a8-9033-451a-b3bd-ea56b2b2ca42 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:46.295291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:46.296904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.297192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.297510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] PATH_INFO: `/v3/projects/87d21b6018d9401e94877cb0d3de109a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.298886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d21b6018d9401e94877cb0d3de109a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:46.326663 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:46.387036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d21b6018d9401e94877cb0d3de109a', 'request_id': 'req-c64302d9-a36f-4184-81f5-f2e7a379b766'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.400007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d21b6018d9401e94877cb0d3de109a', 'request_id': 'req-c64302d9-a36f-4184-81f5-f2e7a379b766'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.409162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d21b6018d9401e94877cb0d3de109a', 'request_id': 'req-c64302d9-a36f-4184-81f5-f2e7a379b766'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.424341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] The token cache is being invalidate because project 87d21b6018d9401e94877cb0d3de109a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:43:46.424588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.425188 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c64302d9-a36f-4184-81f5-f2e7a379b766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:43:46.426828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1222/2434] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:43:46 2021] DELETE /identity/v3/projects/87d21b6018d9401e94877cb0d3de109a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:46.433576 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18df6fa-2eeb-4ed9-8443-55439a82686d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.434254 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18df6fa-2eeb-4ed9-8443-55439a82686d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.434633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18df6fa-2eeb-4ed9-8443-55439a82686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.462573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c18df6fa-2eeb-4ed9-8443-55439a82686d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:46.463800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c18df6fa-2eeb-4ed9-8443-55439a82686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:46.577415 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1213/2435] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:46.586458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785a740-9e39-44aa-be7e-c1d037ccb3a6 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.586987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785a740-9e39-44aa-be7e-c1d037ccb3a6 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.587439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785a740-9e39-44aa-be7e-c1d037ccb3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.627501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-7785a740-9e39-44aa-be7e-c1d037ccb3a6 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:46.629517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7785a740-9e39-44aa-be7e-c1d037ccb3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:46.641675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1223/2436] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:46.646979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18df6fa-2eeb-4ed9-8443-55439a82686d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:46.658300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18df6fa-2eeb-4ed9-8443-55439a82686d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:46.664638 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592543e-c4d5-4b21-b7d4-b73538130f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:46.665265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592543e-c4d5-4b21-b7d4-b73538130f28 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.665586 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592543e-c4d5-4b21-b7d4-b73538130f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.666025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592543e-c4d5-4b21-b7d4-b73538130f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.667010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592543e-c4d5-4b21-b7d4-b73538130f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:43:46.667350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592543e-c4d5-4b21-b7d4-b73538130f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:46.697792 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592543e-c4d5-4b21-b7d4-b73538130f28 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:46.716256 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1214/2437] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:43:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:43:46.722997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785a740-9e39-44aa-be7e-c1d037ccb3a6 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:46.733051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785a740-9e39-44aa-be7e-c1d037ccb3a6 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:46.738356 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b5c0e-b097-46ea-bce9-49baa6e1d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:46.738982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b5c0e-b097-46ea-bce9-49baa6e1d34b admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.739438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b5c0e-b097-46ea-bce9-49baa6e1d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.739627 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b5c0e-b097-46ea-bce9-49baa6e1d34b admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.740200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b5c0e-b097-46ea-bce9-49baa6e1d34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:46.767290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b5c0e-b097-46ea-bce9-49baa6e1d34b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:46.809931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1224/2438] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:46 2021] POST /identity/v3/projects => generated 409 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:43:46.814218 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592543e-c4d5-4b21-b7d4-b73538130f28 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:46.827353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592543e-c4d5-4b21-b7d4-b73538130f28 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:46.902291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab40af-e04c-42fe-bb00-01236f562e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:46.902916 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab40af-e04c-42fe-bb00-01236f562e97 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.903569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab40af-e04c-42fe-bb00-01236f562e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.903569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab40af-e04c-42fe-bb00-01236f562e97 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.904097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab40af-e04c-42fe-bb00-01236f562e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:46.930104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab40af-e04c-42fe-bb00-01236f562e97 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:46.959998 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1215/2439] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:46 2021] POST /identity/v3/users => generated 305 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:46.964746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b5c0e-b097-46ea-bce9-49baa6e1d34b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:46.980888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b5c0e-b097-46ea-bce9-49baa6e1d34b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:46.993720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575818d-7b64-48a0-a7fb-f3cbd9ac43f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:46.993720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575818d-7b64-48a0-a7fb-f3cbd9ac43f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:46.993720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575818d-7b64-48a0-a7fb-f3cbd9ac43f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:46.993720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575818d-7b64-48a0-a7fb-f3cbd9ac43f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:46.994271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575818d-7b64-48a0-a7fb-f3cbd9ac43f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:47.018551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575818d-7b64-48a0-a7fb-f3cbd9ac43f2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.035360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1225/2440] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:46 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:47.039933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab40af-e04c-42fe-bb00-01236f562e97 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.055146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab40af-e04c-42fe-bb00-01236f562e97 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.062419 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210b0ac-f6f9-43c2-b767-4a772c19ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.063976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b0ac-f6f9-43c2-b767-4a772c19ea7d admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.064765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b0ac-f6f9-43c2-b767-4a772c19ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.065012 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b0ac-f6f9-43c2-b767-4a772c19ea7d admin admin] PATH_INFO: `/v3/projects/494ca10a1c104cabaa4164753c330e2b/users/8b938602f141424d9a48d22f55775ffa/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.094136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210b0ac-f6f9-43c2-b767-4a772c19ea7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=494ca10a1c104cabaa4164753c330e2b, user_id=8b938602f141424d9a48d22f55775ffa, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:47.146659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210b0ac-f6f9-43c2-b767-4a772c19ea7d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.162995 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1216/2441] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:47 2021] PUT /identity/v3/projects/494ca10a1c104cabaa4164753c330e2b/users/8b938602f141424d9a48d22f55775ffa/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:47.176967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588300af-b1e3-4bb3-b567-1fc8eba2d75e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.177403 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588300af-b1e3-4bb3-b567-1fc8eba2d75e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.177833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588300af-b1e3-4bb3-b567-1fc8eba2d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.235543 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-588300af-b1e3-4bb3-b567-1fc8eba2d75e None None] MFA Rules not processed for user `8b938602f141424d9a48d22f55775ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:47.236975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-588300af-b1e3-4bb3-b567-1fc8eba2d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:47.329719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1226/2442] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:47 2021] POST /identity/v3/auth/tokens => generated 3716 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:47.335763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210b0ac-f6f9-43c2-b767-4a772c19ea7d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.434025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210b0ac-f6f9-43c2-b767-4a772c19ea7d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.440520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677293-c4ec-40fe-b083-c39251fe667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.441668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677293-c4ec-40fe-b083-c39251fe667c admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.441979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677293-c4ec-40fe-b083-c39251fe667c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.442290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677293-c4ec-40fe-b083-c39251fe667c admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.443055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb677293-c4ec-40fe-b083-c39251fe667c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:47.470267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb677293-c4ec-40fe-b083-c39251fe667c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.506458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1217/2443] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:43:47 2021] POST /identity/v3/projects => generated 407 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:47.511532 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588300af-b1e3-4bb3-b567-1fc8eba2d75e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.523857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588300af-b1e3-4bb3-b567-1fc8eba2d75e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.611227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f60e0-370e-4db4-8b6f-91f19ec5974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.612670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f60e0-370e-4db4-8b6f-91f19ec5974f admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.613129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f60e0-370e-4db4-8b6f-91f19ec5974f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.613566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f60e0-370e-4db4-8b6f-91f19ec5974f admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.614637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f60e0-370e-4db4-8b6f-91f19ec5974f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:47.658980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f60e0-370e-4db4-8b6f-91f19ec5974f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.697029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1227/2444] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:43:47 2021] POST /identity/v3/users => generated 310 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:43:47.705704 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677293-c4ec-40fe-b083-c39251fe667c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.721286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677293-c4ec-40fe-b083-c39251fe667c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.731060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c577-65b1-4cfb-9be1-e604c95c3d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.731858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c577-65b1-4cfb-9be1-e604c95c3d47 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.732369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c577-65b1-4cfb-9be1-e604c95c3d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.732845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c577-65b1-4cfb-9be1-e604c95c3d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.733834 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8c577-65b1-4cfb-9be1-e604c95c3d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:47.762833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8c577-65b1-4cfb-9be1-e604c95c3d47 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.777836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1218/2445] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:47 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:47.781781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f60e0-370e-4db4-8b6f-91f19ec5974f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.795777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f60e0-370e-4db4-8b6f-91f19ec5974f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:47.803192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb774e-2591-4010-9bbf-1d1c72ac8a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:47.804646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb774e-2591-4010-9bbf-1d1c72ac8a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:47.805109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb774e-2591-4010-9bbf-1d1c72ac8a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:47.805599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb774e-2591-4010-9bbf-1d1c72ac8a44 admin admin] PATH_INFO: `/v3/projects/75cb571d694e45dc99850aba46453877/users/ae732b4397f74496a1f4cd6e6f877f66/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:47.839975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb774e-2591-4010-9bbf-1d1c72ac8a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cb571d694e45dc99850aba46453877, user_id=ae732b4397f74496a1f4cd6e6f877f66, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:47.877962 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb774e-2591-4010-9bbf-1d1c72ac8a44 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:47.894329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1228/2446] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:47 2021] PUT /identity/v3/projects/75cb571d694e45dc99850aba46453877/users/ae732b4397f74496a1f4cd6e6f877f66/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:43:47.901184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c577-65b1-4cfb-9be1-e604c95c3d47 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:47.920156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c577-65b1-4cfb-9be1-e604c95c3d47 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.036221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73415e-6a0b-4829-8515-1eaa13f9597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.037220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73415e-6a0b-4829-8515-1eaa13f9597f admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.037720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73415e-6a0b-4829-8515-1eaa13f9597f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.038302 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73415e-6a0b-4829-8515-1eaa13f9597f admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.039563 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73415e-6a0b-4829-8515-1eaa13f9597f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:48.091200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73415e-6a0b-4829-8515-1eaa13f9597f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.112681 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1219/2447] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:47 2021] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:43:48.118263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb774e-2591-4010-9bbf-1d1c72ac8a44 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.132996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb774e-2591-4010-9bbf-1d1c72ac8a44 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.139437 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9652c9-0d74-4766-b9d8-0046d0eb6963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.140755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9652c9-0d74-4766-b9d8-0046d0eb6963 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.141171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9652c9-0d74-4766-b9d8-0046d0eb6963 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.141640 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9652c9-0d74-4766-b9d8-0046d0eb6963 admin admin] PATH_INFO: `/v3/projects/75cb571d694e45dc99850aba46453877/users/ae732b4397f74496a1f4cd6e6f877f66/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.144229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9652c9-0d74-4766-b9d8-0046d0eb6963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cb571d694e45dc99850aba46453877, user_id=ae732b4397f74496a1f4cd6e6f877f66, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:48.179896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9652c9-0d74-4766-b9d8-0046d0eb6963 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.193474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1229/2448] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:48 2021] PUT /identity/v3/projects/75cb571d694e45dc99850aba46453877/users/ae732b4397f74496a1f4cd6e6f877f66/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:48.201425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73415e-6a0b-4829-8515-1eaa13f9597f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.227895 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73415e-6a0b-4829-8515-1eaa13f9597f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.333828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5712-0322-441b-a348-f11902cf4299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.334384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5712-0322-441b-a348-f11902cf4299 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.334670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5712-0322-441b-a348-f11902cf4299 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.334954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5712-0322-441b-a348-f11902cf4299 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.335652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5712-0322-441b-a348-f11902cf4299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:48.362821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5712-0322-441b-a348-f11902cf4299 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.375153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1220/2449] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:43:48 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:43:48.381132 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9652c9-0d74-4766-b9d8-0046d0eb6963 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.399681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9652c9-0d74-4766-b9d8-0046d0eb6963 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.413028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c20144-b859-40bf-85d9-870740d629ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.414066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c20144-b859-40bf-85d9-870740d629ac admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.414887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c20144-b859-40bf-85d9-870740d629ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.415184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c20144-b859-40bf-85d9-870740d629ac admin admin] PATH_INFO: `/v3/projects/75cb571d694e45dc99850aba46453877/users/ae732b4397f74496a1f4cd6e6f877f66/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.417654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c20144-b859-40bf-85d9-870740d629ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cb571d694e45dc99850aba46453877, user_id=ae732b4397f74496a1f4cd6e6f877f66, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:48.444886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c20144-b859-40bf-85d9-870740d629ac admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.461754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1230/2450] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:43:48 2021] PUT /identity/v3/projects/75cb571d694e45dc99850aba46453877/users/ae732b4397f74496a1f4cd6e6f877f66/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:43:48.472021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e75a5-a5d4-4a61-ae17-1e2a6be89ee5 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.472817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e75a5-a5d4-4a61-ae17-1e2a6be89ee5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.472817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e75a5-a5d4-4a61-ae17-1e2a6be89ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.520272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-9b6e75a5-a5d4-4a61-ae17-1e2a6be89ee5 None None] MFA Rules not processed for user `ae732b4397f74496a1f4cd6e6f877f66`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:43:48.521517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9b6e75a5-a5d4-4a61-ae17-1e2a6be89ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:48.633642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1221/2451] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:43:48 2021] POST /identity/v3/auth/tokens => generated 3781 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:43:48.647091 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c20144-b859-40bf-85d9-870740d629ac admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:48.649586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-34c20144-b859-40bf-85d9-870740d629ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:43:48.782843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c20144-b859-40bf-85d9-870740d629ac admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:48.788634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d5335-d4cd-4ef6-bd60-e765977c0b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:48.789687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d5335-d4cd-4ef6-bd60-e765977c0b07 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:48.790277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d5335-d4cd-4ef6-bd60-e765977c0b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:48.790796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d5335-d4cd-4ef6-bd60-e765977c0b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:48.808929 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d5335-d4cd-4ef6-bd60-e765977c0b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:48.865415 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d5335-d4cd-4ef6-bd60-e765977c0b07 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:48.885085 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1231/2452] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:48 2021] GET /identity/v3/auth/tokens => generated 3781 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:43:49.215175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e75a5-a5d4-4a61-ae17-1e2a6be89ee5 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:43:49.226645 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e75a5-a5d4-4a61-ae17-1e2a6be89ee5 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:43:49.230035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edde2c-8c8a-4101-a5c9-ddee6980ebc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:43:49.230630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edde2c-8c8a-4101-a5c9-ddee6980ebc9 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:43:49.230912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edde2c-8c8a-4101-a5c9-ddee6980ebc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:43:49.231185 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edde2c-8c8a-4101-a5c9-ddee6980ebc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:43:49.308251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edde2c-8c8a-4101-a5c9-ddee6980ebc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:43:49.338036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edde2c-8c8a-4101-a5c9-ddee6980ebc9 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:43:49.349013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1222/2453] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:43:49 2021] GET /identity/v3/auth/tokens => generated 3716 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:19.386597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d5335-d4cd-4ef6-bd60-e765977c0b07 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:19.482486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d5335-d4cd-4ef6-bd60-e765977c0b07 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:19.490142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:19.491590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:19.492100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:19.492607 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] PATH_INFO: `/v3/users/8b938602f141424d9a48d22f55775ffa` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:19.494993 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b938602f141424d9a48d22f55775ffa)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:19.557980 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:19.634469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b938602f141424d9a48d22f55775ffa'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:19.643661 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b938602f141424d9a48d22f55775ffa'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:19.644390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b938602f141424d9a48d22f55775ffa'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:19.652514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b938602f141424d9a48d22f55775ffa'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:19.666475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b938602f141424d9a48d22f55775ffa'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:19.673508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1232/2454] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:19 2021] DELETE /identity/v3/users/8b938602f141424d9a48d22f55775ffa => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:19.678817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf417d0-7fd3-4929-b34c-17d619fa0e50 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:19.679454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf417d0-7fd3-4929-b34c-17d619fa0e50 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:19.679454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf417d0-7fd3-4929-b34c-17d619fa0e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:19.705396 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-9bf417d0-7fd3-4929-b34c-17d619fa0e50 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:19.706617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9bf417d0-7fd3-4929-b34c-17d619fa0e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:19.803605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1223/2455] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:19.816262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:19.818930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:19.927591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b653a2d-d829-4504-af2a-bbf7909f250f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:19.932725 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7084ccb-7944-457c-886e-2f97052c5677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:19.933589 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084ccb-7944-457c-886e-2f97052c5677 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:19.934017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084ccb-7944-457c-886e-2f97052c5677 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:19.934462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084ccb-7944-457c-886e-2f97052c5677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:19.948947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7084ccb-7944-457c-886e-2f97052c5677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:19.993610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7084ccb-7944-457c-886e-2f97052c5677 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:20.012144 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1233/2456] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:20.539558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf417d0-7fd3-4929-b34c-17d619fa0e50 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:20.541596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9bf417d0-7fd3-4929-b34c-17d619fa0e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:20.562316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf417d0-7fd3-4929-b34c-17d619fa0e50 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:20.568410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:20.569412 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:20.569749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:20.570156 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] PATH_INFO: `/v3/projects/494ca10a1c104cabaa4164753c330e2b` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:20.571902 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=494ca10a1c104cabaa4164753c330e2b)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:20.611100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:20.696192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494ca10a1c104cabaa4164753c330e2b', 'request_id': 'req-bbac0890-dcf6-4643-8725-401c5c90fb1f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.708549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494ca10a1c104cabaa4164753c330e2b', 'request_id': 'req-bbac0890-dcf6-4643-8725-401c5c90fb1f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.717870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494ca10a1c104cabaa4164753c330e2b', 'request_id': 'req-bbac0890-dcf6-4643-8725-401c5c90fb1f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.731685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] The token cache is being invalidate because project 494ca10a1c104cabaa4164753c330e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:20.732060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.732608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.734105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1224/2457] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:20 2021] DELETE /identity/v3/projects/494ca10a1c104cabaa4164753c330e2b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:20.738573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7084ccb-7944-457c-886e-2f97052c5677 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:20.749778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7084ccb-7944-457c-886e-2f97052c5677 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:20.834877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:20.836151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:20.836398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:20.836706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] PATH_INFO: `/v3/users/ae732b4397f74496a1f4cd6e6f877f66` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:20.838170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae732b4397f74496a1f4cd6e6f877f66)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:20.868008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:20.930176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae732b4397f74496a1f4cd6e6f877f66'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.939617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae732b4397f74496a1f4cd6e6f877f66'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.940419 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae732b4397f74496a1f4cd6e6f877f66'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.949827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae732b4397f74496a1f4cd6e6f877f66'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.966299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a735cdc8-2530-4878-a014-f119bd3c7a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae732b4397f74496a1f4cd6e6f877f66'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:20.972827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1234/2458] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:20 2021] DELETE /identity/v3/users/ae732b4397f74496a1f4cd6e6f877f66 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:21.427994 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:21.429967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:21.448119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0890-dcf6-4643-8725-401c5c90fb1f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:21.568033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:21.569348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.569842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.570394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] PATH_INFO: `/v3/projects/75cb571d694e45dc99850aba46453877` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.572425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cb571d694e45dc99850aba46453877)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:21.628942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:21.698634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cb571d694e45dc99850aba46453877', 'request_id': 'req-409df970-68ed-4dd8-b87d-3d739b6a4609'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:21.713354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cb571d694e45dc99850aba46453877', 'request_id': 'req-409df970-68ed-4dd8-b87d-3d739b6a4609'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:21.722856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cb571d694e45dc99850aba46453877', 'request_id': 'req-409df970-68ed-4dd8-b87d-3d739b6a4609'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:21.735617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] The token cache is being invalidate because project 75cb571d694e45dc99850aba46453877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:21.735984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:21.736689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-409df970-68ed-4dd8-b87d-3d739b6a4609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:21.738348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1225/2459] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:21 2021] DELETE /identity/v3/projects/75cb571d694e45dc99850aba46453877 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:21.745600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df20005-d30a-4301-9627-be6ca4791bdc None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.746207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df20005-d30a-4301-9627-be6ca4791bdc None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.746364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df20005-d30a-4301-9627-be6ca4791bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.775459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3df20005-d30a-4301-9627-be6ca4791bdc None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:21.776825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3df20005-d30a-4301-9627-be6ca4791bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:21.857275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1235/2460] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:21.865503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff2b62-183b-4ada-b335-b8be902dfb94 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.865824 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff2b62-183b-4ada-b335-b8be902dfb94 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.866285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff2b62-183b-4ada-b335-b8be902dfb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.897187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c4ff2b62-183b-4ada-b335-b8be902dfb94 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:21.899113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c4ff2b62-183b-4ada-b335-b8be902dfb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:21.908992 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1226/2461] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:21.914733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df20005-d30a-4301-9627-be6ca4791bdc None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:21.927366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df20005-d30a-4301-9627-be6ca4791bdc None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:21.934502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd91de7-c70f-4978-ab60-6762eb711b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:21.935391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd91de7-c70f-4978-ab60-6762eb711b29 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:21.935872 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd91de7-c70f-4978-ab60-6762eb711b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:21.936343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd91de7-c70f-4978-ab60-6762eb711b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:21.937538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd91de7-c70f-4978-ab60-6762eb711b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:44:21.938062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd91de7-c70f-4978-ab60-6762eb711b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:21.979949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd91de7-c70f-4978-ab60-6762eb711b29 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:22.001227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1236/2462] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:44:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:44:22.008307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff2b62-183b-4ada-b335-b8be902dfb94 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:22.018403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff2b62-183b-4ada-b335-b8be902dfb94 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:22.023249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65deac4-05a5-4520-b078-5407729506cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:22.023909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65deac4-05a5-4520-b078-5407729506cf admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:22.024231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65deac4-05a5-4520-b078-5407729506cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:22.024513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65deac4-05a5-4520-b078-5407729506cf admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:22.025256 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65deac4-05a5-4520-b078-5407729506cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:22.054172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65deac4-05a5-4520-b078-5407729506cf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:22.107516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1227/2463] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:22 2021] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:22.113164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd91de7-c70f-4978-ab60-6762eb711b29 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:22.129014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd91de7-c70f-4978-ab60-6762eb711b29 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:22.229142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd356b81-69ba-493b-98d5-c70fa17cd994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:22.229774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd356b81-69ba-493b-98d5-c70fa17cd994 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:22.230093 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd356b81-69ba-493b-98d5-c70fa17cd994 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:22.230381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd356b81-69ba-493b-98d5-c70fa17cd994 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:22.231080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd356b81-69ba-493b-98d5-c70fa17cd994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:22.257735 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd356b81-69ba-493b-98d5-c70fa17cd994 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:22.280635 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1237/2464] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:22 2021] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:22.284909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65deac4-05a5-4520-b078-5407729506cf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:22.295772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65deac4-05a5-4520-b078-5407729506cf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:22.300966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa831a9-a8fb-42e2-89e0-15238769e996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:22.301842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa831a9-a8fb-42e2-89e0-15238769e996 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:22.302180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa831a9-a8fb-42e2-89e0-15238769e996 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:22.302456 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa831a9-a8fb-42e2-89e0-15238769e996 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:22.303152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa831a9-a8fb-42e2-89e0-15238769e996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:22.329295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa831a9-a8fb-42e2-89e0-15238769e996 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:22.341210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1228/2465] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:22 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:22.346099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd356b81-69ba-493b-98d5-c70fa17cd994 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:22.362069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd356b81-69ba-493b-98d5-c70fa17cd994 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:22.368066 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038cd6a-8480-4ab6-9f32-b60a90ffe22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:22.369135 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038cd6a-8480-4ab6-9f32-b60a90ffe22b admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:22.369903 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038cd6a-8480-4ab6-9f32-b60a90ffe22b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:22.370441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038cd6a-8480-4ab6-9f32-b60a90ffe22b admin admin] PATH_INFO: `/v3/projects/97357af168444182bfb04b68cf65ccd9/users/7bc245797cf241a7b465d90789e9c4d5/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:22.394715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038cd6a-8480-4ab6-9f32-b60a90ffe22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=97357af168444182bfb04b68cf65ccd9, user_id=7bc245797cf241a7b465d90789e9c4d5, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:22.426476 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038cd6a-8480-4ab6-9f32-b60a90ffe22b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:22.462175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1238/2466] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:22 2021] PUT /identity/v3/projects/97357af168444182bfb04b68cf65ccd9/users/7bc245797cf241a7b465d90789e9c4d5/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:22.467649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f714719-b1a9-47a8-8835-029fda1bf89e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:22.468188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f714719-b1a9-47a8-8835-029fda1bf89e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:22.468734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f714719-b1a9-47a8-8835-029fda1bf89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:22.540665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0f714719-b1a9-47a8-8835-029fda1bf89e None None] MFA Rules not processed for user `7bc245797cf241a7b465d90789e9c4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:22.542347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0f714719-b1a9-47a8-8835-029fda1bf89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:22.660113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1229/2467] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:22 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:22.666831 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038cd6a-8480-4ab6-9f32-b60a90ffe22b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:22.757971 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038cd6a-8480-4ab6-9f32-b60a90ffe22b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:22.762591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071f90-0094-4341-8502-2b54ab0ba219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:22.763209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071f90-0094-4341-8502-2b54ab0ba219 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:22.763501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071f90-0094-4341-8502-2b54ab0ba219 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:22.763766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071f90-0094-4341-8502-2b54ab0ba219 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:22.764444 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39071f90-0094-4341-8502-2b54ab0ba219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:22.790739 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39071f90-0094-4341-8502-2b54ab0ba219 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:22.820155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1239/2468] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:22 2021] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:22.825952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f714719-b1a9-47a8-8835-029fda1bf89e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:22.839432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f714719-b1a9-47a8-8835-029fda1bf89e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:22.914400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c37b9-91c6-418c-88ca-49c8ba9a239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:22.915160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c37b9-91c6-418c-88ca-49c8ba9a239d admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:22.915428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c37b9-91c6-418c-88ca-49c8ba9a239d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:22.915911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c37b9-91c6-418c-88ca-49c8ba9a239d admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:22.916797 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c37b9-91c6-418c-88ca-49c8ba9a239d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:22.944265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c37b9-91c6-418c-88ca-49c8ba9a239d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:22.972023 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1230/2469] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:22 2021] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:22.976895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071f90-0094-4341-8502-2b54ab0ba219 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:22.991983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071f90-0094-4341-8502-2b54ab0ba219 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:22.999254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16989281-7ffe-4ec3-8a81-fb4f2a3f2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:23.000291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16989281-7ffe-4ec3-8a81-fb4f2a3f2111 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:23.000650 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16989281-7ffe-4ec3-8a81-fb4f2a3f2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:23.000932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16989281-7ffe-4ec3-8a81-fb4f2a3f2111 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:23.001709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16989281-7ffe-4ec3-8a81-fb4f2a3f2111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:23.028704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16989281-7ffe-4ec3-8a81-fb4f2a3f2111 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:23.042628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1240/2470] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:22 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:23.047148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c37b9-91c6-418c-88ca-49c8ba9a239d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:23.060669 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c37b9-91c6-418c-88ca-49c8ba9a239d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:23.068221 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520b1a0-f9ba-43ab-9ac2-c63349703691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:23.069798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520b1a0-f9ba-43ab-9ac2-c63349703691 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:23.070345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520b1a0-f9ba-43ab-9ac2-c63349703691 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:23.070853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520b1a0-f9ba-43ab-9ac2-c63349703691 admin admin] PATH_INFO: `/v3/projects/6220e7b354a6492289ce62200b293a75/users/37b3e023bc184e7db4fcd26c2fcaead7/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:23.106740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520b1a0-f9ba-43ab-9ac2-c63349703691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6220e7b354a6492289ce62200b293a75, user_id=37b3e023bc184e7db4fcd26c2fcaead7, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:23.142559 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520b1a0-f9ba-43ab-9ac2-c63349703691 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:23.160216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1231/2471] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:23 2021] PUT /identity/v3/projects/6220e7b354a6492289ce62200b293a75/users/37b3e023bc184e7db4fcd26c2fcaead7/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:23.165877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16989281-7ffe-4ec3-8a81-fb4f2a3f2111 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:23.179672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16989281-7ffe-4ec3-8a81-fb4f2a3f2111 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:23.259762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2cfbf-b1d1-4d33-89c4-07fe450eee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:23.260384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2cfbf-b1d1-4d33-89c4-07fe450eee0d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:23.260666 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2cfbf-b1d1-4d33-89c4-07fe450eee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:23.260932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2cfbf-b1d1-4d33-89c4-07fe450eee0d admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:23.261626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2cfbf-b1d1-4d33-89c4-07fe450eee0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:23.287624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2cfbf-b1d1-4d33-89c4-07fe450eee0d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:23.299463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1241/2472] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:23 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:23.304264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520b1a0-f9ba-43ab-9ac2-c63349703691 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:23.318425 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520b1a0-f9ba-43ab-9ac2-c63349703691 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:23.326737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a7e1-8a73-4a17-b582-f6a56e6cf39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:23.328367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a7e1-8a73-4a17-b582-f6a56e6cf39c admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:23.328870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a7e1-8a73-4a17-b582-f6a56e6cf39c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:23.329440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a7e1-8a73-4a17-b582-f6a56e6cf39c admin admin] PATH_INFO: `/v3/projects/6220e7b354a6492289ce62200b293a75/users/37b3e023bc184e7db4fcd26c2fcaead7/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:23.333728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774a7e1-8a73-4a17-b582-f6a56e6cf39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6220e7b354a6492289ce62200b293a75, user_id=37b3e023bc184e7db4fcd26c2fcaead7, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:23.364072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774a7e1-8a73-4a17-b582-f6a56e6cf39c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:23.375840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1232/2473] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:23 2021] PUT /identity/v3/projects/6220e7b354a6492289ce62200b293a75/users/37b3e023bc184e7db4fcd26c2fcaead7/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:23.380805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2cfbf-b1d1-4d33-89c4-07fe450eee0d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:23.390869 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2cfbf-b1d1-4d33-89c4-07fe450eee0d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:23.469009 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cac25d-6091-441b-a1ec-d58a45a9920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:23.470201 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac25d-6091-441b-a1ec-d58a45a9920c admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:23.470481 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac25d-6091-441b-a1ec-d58a45a9920c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:23.470812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac25d-6091-441b-a1ec-d58a45a9920c admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:23.471578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cac25d-6091-441b-a1ec-d58a45a9920c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:23.506229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cac25d-6091-441b-a1ec-d58a45a9920c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:23.530013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1242/2474] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:23 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:23.531729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a7e1-8a73-4a17-b582-f6a56e6cf39c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:23.544066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a7e1-8a73-4a17-b582-f6a56e6cf39c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:23.549580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0aaad-00ce-4aa5-a417-d0f70b8bd44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:23.550816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0aaad-00ce-4aa5-a417-d0f70b8bd44e admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:23.551364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0aaad-00ce-4aa5-a417-d0f70b8bd44e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:23.551893 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0aaad-00ce-4aa5-a417-d0f70b8bd44e admin admin] PATH_INFO: `/v3/projects/6220e7b354a6492289ce62200b293a75/users/37b3e023bc184e7db4fcd26c2fcaead7/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:23.555664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0aaad-00ce-4aa5-a417-d0f70b8bd44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6220e7b354a6492289ce62200b293a75, user_id=37b3e023bc184e7db4fcd26c2fcaead7, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:23.585800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0aaad-00ce-4aa5-a417-d0f70b8bd44e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:23.607345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1233/2475] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:23 2021] PUT /identity/v3/projects/6220e7b354a6492289ce62200b293a75/users/37b3e023bc184e7db4fcd26c2fcaead7/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:23.623649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006a985-c879-46bf-b572-328be6af3a18 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:23.623835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006a985-c879-46bf-b572-328be6af3a18 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:23.624129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006a985-c879-46bf-b572-328be6af3a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:23.663301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-a006a985-c879-46bf-b572-328be6af3a18 None None] MFA Rules not processed for user `37b3e023bc184e7db4fcd26c2fcaead7`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:23.664473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a006a985-c879-46bf-b572-328be6af3a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:23.747098 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1243/2476] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:23 2021] POST /identity/v3/auth/tokens => generated 3741 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:23.757875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0aaad-00ce-4aa5-a417-d0f70b8bd44e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:23.760062 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8ac0aaad-00ce-4aa5-a417-d0f70b8bd44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:23.833936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0aaad-00ce-4aa5-a417-d0f70b8bd44e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:23.839057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3ba9-980b-424a-8c6c-0afe0a0cafad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:23.839671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3ba9-980b-424a-8c6c-0afe0a0cafad service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:23.840097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3ba9-980b-424a-8c6c-0afe0a0cafad service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:23.840375 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3ba9-980b-424a-8c6c-0afe0a0cafad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:23.850439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3ba9-980b-424a-8c6c-0afe0a0cafad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:23.876690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3ba9-980b-424a-8c6c-0afe0a0cafad service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:23.888977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1234/2477] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:23 2021] GET /identity/v3/auth/tokens => generated 3741 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:24.013102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006a985-c879-46bf-b572-328be6af3a18 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:24.025670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006a985-c879-46bf-b572-328be6af3a18 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:24.029272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4903ad5-1b30-4d03-ae0f-2d9a21c1eb9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:24.029852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903ad5-1b30-4d03-ae0f-2d9a21c1eb9d service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:24.030163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903ad5-1b30-4d03-ae0f-2d9a21c1eb9d service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:24.030592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903ad5-1b30-4d03-ae0f-2d9a21c1eb9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:24.107167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4903ad5-1b30-4d03-ae0f-2d9a21c1eb9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:24.134533 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4903ad5-1b30-4d03-ae0f-2d9a21c1eb9d service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:24.144299 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1244/2478] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:24 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:29.833423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3ba9-980b-424a-8c6c-0afe0a0cafad service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:29.835144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4c0e3ba9-980b-424a-8c6c-0afe0a0cafad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:29.917385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3ba9-980b-424a-8c6c-0afe0a0cafad service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:29.922343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:29.923245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:29.923508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:29.923810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] PATH_INFO: `/v3/users/727f832d25ef4ac4bff2ae504d84eb75` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:29.925052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=727f832d25ef4ac4bff2ae504d84eb75)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:29.952912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:30.031069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727f832d25ef4ac4bff2ae504d84eb75'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.055661 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727f832d25ef4ac4bff2ae504d84eb75'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.074137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727f832d25ef4ac4bff2ae504d84eb75'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.075463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727f832d25ef4ac4bff2ae504d84eb75'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.089092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727f832d25ef4ac4bff2ae504d84eb75'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.100928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1235/2479] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:29 2021] DELETE /identity/v3/users/727f832d25ef4ac4bff2ae504d84eb75 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:30.108419 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcde13-bee4-479a-847b-0026317661c0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:30.109766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcde13-bee4-479a-847b-0026317661c0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:30.110284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcde13-bee4-479a-847b-0026317661c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:30.153320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-00fcde13-bee4-479a-847b-0026317661c0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:30.155921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-00fcde13-bee4-479a-847b-0026317661c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:30.259241 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1245/2480] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:30.274845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:30.276263 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:30.381399 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfe609-6357-48f9-8df3-1b18c23d55c7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:30.387060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46e87d-b28d-4507-9fe0-f0e63d3e1aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:30.388494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e87d-b28d-4507-9fe0-f0e63d3e1aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:30.388689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e87d-b28d-4507-9fe0-f0e63d3e1aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:30.389338 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e87d-b28d-4507-9fe0-f0e63d3e1aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:30.407129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46e87d-b28d-4507-9fe0-f0e63d3e1aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:30.455591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46e87d-b28d-4507-9fe0-f0e63d3e1aa3 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:30.473659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1236/2481] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:30.676729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcde13-bee4-479a-847b-0026317661c0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:30.679394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-00fcde13-bee4-479a-847b-0026317661c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:30.690924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcde13-bee4-479a-847b-0026317661c0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:30.698407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:30.699801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:30.700293 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:30.700892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] PATH_INFO: `/v3/users/7bc245797cf241a7b465d90789e9c4d5` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:30.703168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc245797cf241a7b465d90789e9c4d5)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:30.758756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:30.839818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc245797cf241a7b465d90789e9c4d5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.851738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc245797cf241a7b465d90789e9c4d5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.853064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc245797cf241a7b465d90789e9c4d5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.864910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc245797cf241a7b465d90789e9c4d5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.881757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc245797cf241a7b465d90789e9c4d5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:30.890952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1246/2482] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:30 2021] DELETE /identity/v3/users/7bc245797cf241a7b465d90789e9c4d5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:30.898828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768a8e-ac2f-48f9-9b68-482b1e21037e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:30.899474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768a8e-ac2f-48f9-9b68-482b1e21037e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:30.900149 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768a8e-ac2f-48f9-9b68-482b1e21037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:30.941125 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-da768a8e-ac2f-48f9-9b68-482b1e21037e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:30.943565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-da768a8e-ac2f-48f9-9b68-482b1e21037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:31.021108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1237/2483] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:31.035921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.038366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:31.053811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da768a8e-ac2f-48f9-9b68-482b1e21037e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.055541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-da768a8e-ac2f-48f9-9b68-482b1e21037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:31.073367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da768a8e-ac2f-48f9-9b68-482b1e21037e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:31.079386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:31.080438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.080876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.081116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] PATH_INFO: `/v3/projects/b1eaa5e490594491bd701932cf0d2222` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.082597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1eaa5e490594491bd701932cf0d2222)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:31.124170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:31.131877 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b585-aadc-4d69-9b3b-7fde24fd9dda admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:31.136326 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821adaf3-c4e8-4259-9d48-df38ee36ff1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:31.137134 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821adaf3-c4e8-4259-9d48-df38ee36ff1a service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.137898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821adaf3-c4e8-4259-9d48-df38ee36ff1a service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.137898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821adaf3-c4e8-4259-9d48-df38ee36ff1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.151220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821adaf3-c4e8-4259-9d48-df38ee36ff1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:31.179090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821adaf3-c4e8-4259-9d48-df38ee36ff1a service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:31.189440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1247/2484] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:31.194590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1eaa5e490594491bd701932cf0d2222', 'request_id': 'req-386bddae-3e20-446d-8350-8eea304e5281'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.206520 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1eaa5e490594491bd701932cf0d2222', 'request_id': 'req-386bddae-3e20-446d-8350-8eea304e5281'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.216617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1eaa5e490594491bd701932cf0d2222', 'request_id': 'req-386bddae-3e20-446d-8350-8eea304e5281'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.229807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] The token cache is being invalidate because project b1eaa5e490594491bd701932cf0d2222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:31.230251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.230978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-386bddae-3e20-446d-8350-8eea304e5281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.232457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1238/2485] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:31 2021] DELETE /identity/v3/projects/b1eaa5e490594491bd701932cf0d2222 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:31.238885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd5127-e5d5-433f-b888-1fcb0436068d None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.239213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd5127-e5d5-433f-b888-1fcb0436068d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.239618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd5127-e5d5-433f-b888-1fcb0436068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.266507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-01cd5127-e5d5-433f-b888-1fcb0436068d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:31.266986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-01cd5127-e5d5-433f-b888-1fcb0436068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:31.350815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1248/2486] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:31.361304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fad03-caa8-4c99-a8b4-49ad149bbc87 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.361792 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fad03-caa8-4c99-a8b4-49ad149bbc87 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.362135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fad03-caa8-4c99-a8b4-49ad149bbc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.390841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-463fad03-caa8-4c99-a8b4-49ad149bbc87 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:31.391928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-463fad03-caa8-4c99-a8b4-49ad149bbc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:31.400062 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1239/2487] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:31.404697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd5127-e5d5-433f-b888-1fcb0436068d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.415901 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd5127-e5d5-433f-b888-1fcb0436068d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:31.422885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7ff90-ebb3-4556-9ebf-517d4f3bb65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:31.423822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7ff90-ebb3-4556-9ebf-517d4f3bb65d admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.424475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7ff90-ebb3-4556-9ebf-517d4f3bb65d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.425155 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7ff90-ebb3-4556-9ebf-517d4f3bb65d admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.426681 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7ff90-ebb3-4556-9ebf-517d4f3bb65d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:44:31.427261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7ff90-ebb3-4556-9ebf-517d4f3bb65d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:31.462738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7ff90-ebb3-4556-9ebf-517d4f3bb65d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:31.494062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1249/2488] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:44:31.500020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fad03-caa8-4c99-a8b4-49ad149bbc87 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.511524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fad03-caa8-4c99-a8b4-49ad149bbc87 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:31.517914 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba05fb-80b4-46e3-b867-3460d9770f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:31.518935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba05fb-80b4-46e3-b867-3460d9770f4d admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.519674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba05fb-80b4-46e3-b867-3460d9770f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.520115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba05fb-80b4-46e3-b867-3460d9770f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.521536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba05fb-80b4-46e3-b867-3460d9770f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:31.558020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba05fb-80b4-46e3-b867-3460d9770f4d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:31.595647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1240/2489] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:31 2021] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:31.600336 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7ff90-ebb3-4556-9ebf-517d4f3bb65d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.613354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7ff90-ebb3-4556-9ebf-517d4f3bb65d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:31.717208 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d7437-b9e3-4645-9149-f9088b096095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:31.719669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7437-b9e3-4645-9149-f9088b096095 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.719669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7437-b9e3-4645-9149-f9088b096095 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.719669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7437-b9e3-4645-9149-f9088b096095 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.720379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d7437-b9e3-4645-9149-f9088b096095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:31.727284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba05fb-80b4-46e3-b867-3460d9770f4d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.729295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-96ba05fb-80b4-46e3-b867-3460d9770f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:31.743968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba05fb-80b4-46e3-b867-3460d9770f4d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:31.747920 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d7437-b9e3-4645-9149-f9088b096095 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:31.753454 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:31.755124 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.756284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.756882 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] PATH_INFO: `/v3/projects/97357af168444182bfb04b68cf65ccd9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.759065 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97357af168444182bfb04b68cf65ccd9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:31.772763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1250/2490] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:31 2021] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:44:31.777031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d7437-b9e3-4645-9149-f9088b096095 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.787404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d7437-b9e3-4645-9149-f9088b096095 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:31.791978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887d72b-7861-44ca-b6ed-89ebba23aff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:31.796902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887d72b-7861-44ca-b6ed-89ebba23aff8 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.797272 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887d72b-7861-44ca-b6ed-89ebba23aff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.797562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887d72b-7861-44ca-b6ed-89ebba23aff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.798316 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887d72b-7861-44ca-b6ed-89ebba23aff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:31.821545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:31.832349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887d72b-7861-44ca-b6ed-89ebba23aff8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:31.844955 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1251/2491] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:31 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:31.849958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887d72b-7861-44ca-b6ed-89ebba23aff8 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.860116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887d72b-7861-44ca-b6ed-89ebba23aff8 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:31.864769 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1527c-0511-483e-866c-6105004e6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:31.865979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1527c-0511-483e-866c-6105004e6f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.866291 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1527c-0511-483e-866c-6105004e6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.866563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1527c-0511-483e-866c-6105004e6f42 admin admin] PATH_INFO: `/v3/projects/7210fc0bdd80446484aaf7f436c2317b/users/a81a0ea6ec044d0a8f5f2ba192414a36/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.895184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1527c-0511-483e-866c-6105004e6f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7210fc0bdd80446484aaf7f436c2317b, user_id=a81a0ea6ec044d0a8f5f2ba192414a36, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:31.909796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97357af168444182bfb04b68cf65ccd9', 'request_id': 'req-21c37d9f-6633-425c-8833-13a9177e8ed1'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.923720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97357af168444182bfb04b68cf65ccd9', 'request_id': 'req-21c37d9f-6633-425c-8833-13a9177e8ed1'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.934355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97357af168444182bfb04b68cf65ccd9', 'request_id': 'req-21c37d9f-6633-425c-8833-13a9177e8ed1'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.941022 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1527c-0511-483e-866c-6105004e6f42 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:31.946318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] The token cache is being invalidate because project 97357af168444182bfb04b68cf65ccd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:31.946676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.947390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:31.948967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1241/2492] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:31 2021] DELETE /identity/v3/projects/97357af168444182bfb04b68cf65ccd9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:31.955505 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:31.956951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:31.960458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1252/2493] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:31 2021] PUT /identity/v3/projects/7210fc0bdd80446484aaf7f436c2317b/users/a81a0ea6ec044d0a8f5f2ba192414a36/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:31.965788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620eda1-266f-40ac-b6e8-78ea8f74082d None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:31.966608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620eda1-266f-40ac-b6e8-78ea8f74082d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:31.966718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620eda1-266f-40ac-b6e8-78ea8f74082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:31.995794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-5620eda1-266f-40ac-b6e8-78ea8f74082d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:31.997061 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5620eda1-266f-40ac-b6e8-78ea8f74082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:32.053887 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c37d9f-6633-425c-8833-13a9177e8ed1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:32.073470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1253/2494] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:32.085075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620eda1-266f-40ac-b6e8-78ea8f74082d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:32.086621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5620eda1-266f-40ac-b6e8-78ea8f74082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:32.158924 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:32.160660 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:32.161054 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:32.161639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] PATH_INFO: `/v3/users/37b3e023bc184e7db4fcd26c2fcaead7` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:32.166668 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b3e023bc184e7db4fcd26c2fcaead7)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:32.175096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620eda1-266f-40ac-b6e8-78ea8f74082d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:32.179469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c064d-5ac5-4d20-ab3d-2eb9fff9b2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:32.180255 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c064d-5ac5-4d20-ab3d-2eb9fff9b2cd service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:32.180747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c064d-5ac5-4d20-ab3d-2eb9fff9b2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:32.181193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c064d-5ac5-4d20-ab3d-2eb9fff9b2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:32.194165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c064d-5ac5-4d20-ab3d-2eb9fff9b2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:32.195368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:32.217947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c064d-5ac5-4d20-ab3d-2eb9fff9b2cd service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:32.229510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1254/2495] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:32.274442 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b3e023bc184e7db4fcd26c2fcaead7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:32.295208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b3e023bc184e7db4fcd26c2fcaead7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:32.306447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b3e023bc184e7db4fcd26c2fcaead7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:32.307328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b3e023bc184e7db4fcd26c2fcaead7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:32.320127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2919e398-3666-45b5-b514-9d352c2a08f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b3e023bc184e7db4fcd26c2fcaead7'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:32.328553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1242/2496] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:31 2021] DELETE /identity/v3/users/37b3e023bc184e7db4fcd26c2fcaead7 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:32.814023 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c064d-5ac5-4d20-ab3d-2eb9fff9b2cd service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:32.825211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c064d-5ac5-4d20-ab3d-2eb9fff9b2cd service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:32.937556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:32.938784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:32.938997 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:32.939257 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] PATH_INFO: `/v3/projects/6220e7b354a6492289ce62200b293a75` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:32.940497 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6220e7b354a6492289ce62200b293a75)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:32.970023 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:33.051775 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6220e7b354a6492289ce62200b293a75', 'request_id': 'req-d875d452-8f57-4e77-9f18-dda93ee2c8a0'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:33.067961 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6220e7b354a6492289ce62200b293a75', 'request_id': 'req-d875d452-8f57-4e77-9f18-dda93ee2c8a0'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:33.077682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6220e7b354a6492289ce62200b293a75', 'request_id': 'req-d875d452-8f57-4e77-9f18-dda93ee2c8a0'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:33.089473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] The token cache is being invalidate because project 6220e7b354a6492289ce62200b293a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:33.089834 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:33.090408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d875d452-8f57-4e77-9f18-dda93ee2c8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:33.091869 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1255/2497] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:32 2021] DELETE /identity/v3/projects/6220e7b354a6492289ce62200b293a75 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:33.098414 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ecf4d-66fc-4b15-9e21-ac926ba209e5 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:33.103555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ecf4d-66fc-4b15-9e21-ac926ba209e5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:33.103555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ecf4d-66fc-4b15-9e21-ac926ba209e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:33.140701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-974ecf4d-66fc-4b15-9e21-ac926ba209e5 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:33.143961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-974ecf4d-66fc-4b15-9e21-ac926ba209e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:33.239485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1243/2498] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:33.250369 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a94c3-b06f-4529-a27f-5695c5bd2939 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:33.251196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a94c3-b06f-4529-a27f-5695c5bd2939 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:33.251196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a94c3-b06f-4529-a27f-5695c5bd2939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:33.279209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-904a94c3-b06f-4529-a27f-5695c5bd2939 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:33.284277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-904a94c3-b06f-4529-a27f-5695c5bd2939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:33.289338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1256/2499] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:33.294286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ecf4d-66fc-4b15-9e21-ac926ba209e5 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:33.311049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ecf4d-66fc-4b15-9e21-ac926ba209e5 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:33.321018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b25a1-076a-4694-85e1-5236762a8f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:33.322117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b25a1-076a-4694-85e1-5236762a8f05 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:33.322617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b25a1-076a-4694-85e1-5236762a8f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:33.323213 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b25a1-076a-4694-85e1-5236762a8f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:33.324423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b25a1-076a-4694-85e1-5236762a8f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:44:33.324882 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b25a1-076a-4694-85e1-5236762a8f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:33.383983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b25a1-076a-4694-85e1-5236762a8f05 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:33.412631 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1244/2500] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:44:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:44:33.417185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a94c3-b06f-4529-a27f-5695c5bd2939 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:33.427281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a94c3-b06f-4529-a27f-5695c5bd2939 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:33.432390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daa8e0-248c-4ae0-aec5-fdcb760d99a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:33.433040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daa8e0-248c-4ae0-aec5-fdcb760d99a6 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:33.433332 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daa8e0-248c-4ae0-aec5-fdcb760d99a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:33.433691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daa8e0-248c-4ae0-aec5-fdcb760d99a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:33.434417 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daa8e0-248c-4ae0-aec5-fdcb760d99a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:33.463671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daa8e0-248c-4ae0-aec5-fdcb760d99a6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:33.500063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1257/2501] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:33 2021] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:33.506061 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b25a1-076a-4694-85e1-5236762a8f05 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:33.522816 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b25a1-076a-4694-85e1-5236762a8f05 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:33.607611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d81a57-4413-4c94-9a3e-713a156f3aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:33.608473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d81a57-4413-4c94-9a3e-713a156f3aef admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:33.609462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d81a57-4413-4c94-9a3e-713a156f3aef admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:33.610021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d81a57-4413-4c94-9a3e-713a156f3aef admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:33.611020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d81a57-4413-4c94-9a3e-713a156f3aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:33.643133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d81a57-4413-4c94-9a3e-713a156f3aef admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:33.668074 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1245/2502] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:33 2021] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:33.672424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daa8e0-248c-4ae0-aec5-fdcb760d99a6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:33.683340 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daa8e0-248c-4ae0-aec5-fdcb760d99a6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:33.688712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec23bd3-2ae1-41f0-afc6-9e8d66057262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:33.689391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec23bd3-2ae1-41f0-afc6-9e8d66057262 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:33.689744 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec23bd3-2ae1-41f0-afc6-9e8d66057262 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:33.690195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec23bd3-2ae1-41f0-afc6-9e8d66057262 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:33.691266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec23bd3-2ae1-41f0-afc6-9e8d66057262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:33.728549 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec23bd3-2ae1-41f0-afc6-9e8d66057262 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:33.753273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1258/2503] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:33 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:33.757938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d81a57-4413-4c94-9a3e-713a156f3aef admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:33.768426 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d81a57-4413-4c94-9a3e-713a156f3aef admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:33.776150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d026cba-b630-476b-8b60-165e6fbee699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:33.777955 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d026cba-b630-476b-8b60-165e6fbee699 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:33.778676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d026cba-b630-476b-8b60-165e6fbee699 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:33.779355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d026cba-b630-476b-8b60-165e6fbee699 admin admin] PATH_INFO: `/v3/projects/bd5f98afb8994bac89739dc127d36521/users/4499831b98ab4ab8b735461120eefaa2/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:33.814265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d026cba-b630-476b-8b60-165e6fbee699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5f98afb8994bac89739dc127d36521, user_id=4499831b98ab4ab8b735461120eefaa2, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:33.842955 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d026cba-b630-476b-8b60-165e6fbee699 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:33.860848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1246/2504] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:33 2021] PUT /identity/v3/projects/bd5f98afb8994bac89739dc127d36521/users/4499831b98ab4ab8b735461120eefaa2/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:33.873072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eda1d6-f9fc-420c-8e28-975b4b22cc10 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:33.873365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eda1d6-f9fc-420c-8e28-975b4b22cc10 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:33.873688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eda1d6-f9fc-420c-8e28-975b4b22cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:33.931080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-04eda1d6-f9fc-420c-8e28-975b4b22cc10 None None] MFA Rules not processed for user `4499831b98ab4ab8b735461120eefaa2`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:33.932331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-04eda1d6-f9fc-420c-8e28-975b4b22cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:34.067354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1259/2505] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:33 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:34.070383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d026cba-b630-476b-8b60-165e6fbee699 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:34.071889 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3d026cba-b630-476b-8b60-165e6fbee699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:34.199844 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eda1d6-f9fc-420c-8e28-975b4b22cc10 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:34.204343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-04eda1d6-f9fc-420c-8e28-975b4b22cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:34.212142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d026cba-b630-476b-8b60-165e6fbee699 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:34.232096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16e187-365a-4711-9981-dd8e725df260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:34.233605 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16e187-365a-4711-9981-dd8e725df260 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:34.234119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16e187-365a-4711-9981-dd8e725df260 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:34.234672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16e187-365a-4711-9981-dd8e725df260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:34.246854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16e187-365a-4711-9981-dd8e725df260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:34.276250 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16e187-365a-4711-9981-dd8e725df260 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:34.288420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1247/2506] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:34 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:34.406836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eda1d6-f9fc-420c-8e28-975b4b22cc10 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:34.416301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:34.417240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:34.417708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:34.418427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:34.421482 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:34.451656 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:34.511524 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:34.543637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1260/2507] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:34 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:44:40.921531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2ea34-7a0e-430b-9803-27bf94eb78da None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:40.922743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2ea34-7a0e-430b-9803-27bf94eb78da None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:40.922743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2ea34-7a0e-430b-9803-27bf94eb78da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.022415 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-e8f2ea34-7a0e-430b-9803-27bf94eb78da None None] MFA Rules not processed for user `a81a0ea6ec044d0a8f5f2ba192414a36`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:41.023837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e8f2ea34-7a0e-430b-9803-27bf94eb78da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:41.150575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1248/2508] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:40 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:41.157882 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:41.161896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:41.337065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00d7c7-1bf5-4bf8-a39b-f6669b1c0f83 service nova] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:41.344019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858312-a6e5-419b-81d3-62b8379baa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:41.344781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858312-a6e5-419b-81d3-62b8379baa04 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.345258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858312-a6e5-419b-81d3-62b8379baa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.345949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858312-a6e5-419b-81d3-62b8379baa04 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.346866 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c858312-a6e5-419b-81d3-62b8379baa04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:41.388783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c858312-a6e5-419b-81d3-62b8379baa04 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:41.400552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2ea34-7a0e-430b-9803-27bf94eb78da None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:41.416272 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2ea34-7a0e-430b-9803-27bf94eb78da None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:41.423658 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:41.425466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.426725 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.427339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] PATH_INFO: `/v3/users/4499831b98ab4ab8b735461120eefaa2` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.429811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4499831b98ab4ab8b735461120eefaa2)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:41.446311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1261/2509] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:41 2021] POST /identity/v3/projects => generated 383 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:44:41.452102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858312-a6e5-419b-81d3-62b8379baa04 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:41.461420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:41.568357 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858312-a6e5-419b-81d3-62b8379baa04 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:41.570423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4499831b98ab4ab8b735461120eefaa2'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.573964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d079e-dae0-4be3-a8d6-698f66ca920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:41.575303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d079e-dae0-4be3-a8d6-698f66ca920d admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.575303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d079e-dae0-4be3-a8d6-698f66ca920d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.575778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d079e-dae0-4be3-a8d6-698f66ca920d admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.576560 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d079e-dae0-4be3-a8d6-698f66ca920d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:41.592792 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4499831b98ab4ab8b735461120eefaa2'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.604639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d079e-dae0-4be3-a8d6-698f66ca920d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:41.607876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4499831b98ab4ab8b735461120eefaa2'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.609561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4499831b98ab4ab8b735461120eefaa2'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.624905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4499831b98ab4ab8b735461120eefaa2'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:41.638350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1249/2510] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:41 2021] DELETE /identity/v3/users/4499831b98ab4ab8b735461120eefaa2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:41.638665 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1262/2511] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:41 2021] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:44:41.644703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:41.644923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e19e46-b93c-45f5-999a-7793f51aa7f0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.645398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e19e46-b93c-45f5-999a-7793f51aa7f0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.645976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e19e46-b93c-45f5-999a-7793f51aa7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.647804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:41.690966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-52e19e46-b93c-45f5-999a-7793f51aa7f0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:41.692439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-52e19e46-b93c-45f5-999a-7793f51aa7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:41.767103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92c2e-d078-418f-bf04-732bf601371d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:41.773107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ade8a-1096-48c6-b4e0-5e8357d96ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:41.774380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ade8a-1096-48c6-b4e0-5e8357d96ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.774687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ade8a-1096-48c6-b4e0-5e8357d96ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.774987 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ade8a-1096-48c6-b4e0-5e8357d96ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.775754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ade8a-1096-48c6-b4e0-5e8357d96ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:41.805507 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1263/2512] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:41.810366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ade8a-1096-48c6-b4e0-5e8357d96ef0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:41.820325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e19e46-b93c-45f5-999a-7793f51aa7f0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:41.825752 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1250/2513] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:41 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:41.825918 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-52e19e46-b93c-45f5-999a-7793f51aa7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:41.827946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ade8a-1096-48c6-b4e0-5e8357d96ef0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:41.850519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ade8a-1096-48c6-b4e0-5e8357d96ef0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:41.857580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82343b-5959-4399-bb59-a8023f2c368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:41.858488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82343b-5959-4399-bb59-a8023f2c368a admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:41.858814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82343b-5959-4399-bb59-a8023f2c368a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:41.859048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82343b-5959-4399-bb59-a8023f2c368a admin admin] PATH_INFO: `/v3/projects/547f832c2adc4d3fb8a618390a506f3c/users/9254961d5b924330818a90ee1653aae4/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:41.894775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82343b-5959-4399-bb59-a8023f2c368a admin admin] RBAC: Authorizing `identity:create_grant(project_id=547f832c2adc4d3fb8a618390a506f3c, user_id=9254961d5b924330818a90ee1653aae4, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:41.942877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82343b-5959-4399-bb59-a8023f2c368a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:41.963909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e19e46-b93c-45f5-999a-7793f51aa7f0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:41.966117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1251/2514] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:41 2021] PUT /identity/v3/projects/547f832c2adc4d3fb8a618390a506f3c/users/9254961d5b924330818a90ee1653aae4/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:41.971234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82343b-5959-4399-bb59-a8023f2c368a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:42.073630 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bbf14-f8c6-4598-9649-3d42a9b3366a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:42.075249 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bbf14-f8c6-4598-9649-3d42a9b3366a service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:42.075979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bbf14-f8c6-4598-9649-3d42a9b3366a service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:42.076466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bbf14-f8c6-4598-9649-3d42a9b3366a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:42.092283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82343b-5959-4399-bb59-a8023f2c368a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:42.100758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9441b5-7072-42f1-9f70-a373cc7997f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:42.101890 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9441b5-7072-42f1-9f70-a373cc7997f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:42.102445 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9441b5-7072-42f1-9f70-a373cc7997f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:42.102791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9441b5-7072-42f1-9f70-a373cc7997f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:42.103815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9441b5-7072-42f1-9f70-a373cc7997f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:42.107063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bbf14-f8c6-4598-9649-3d42a9b3366a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:42.141654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bbf14-f8c6-4598-9649-3d42a9b3366a service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:42.150611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9441b5-7072-42f1-9f70-a373cc7997f7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:42.158881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1264/2515] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:42.171625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1252/2516] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:41 2021] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:42.174237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bbf14-f8c6-4598-9649-3d42a9b3366a service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:42.198587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bbf14-f8c6-4598-9649-3d42a9b3366a service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:42.216112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe639c5-5104-47d8-9b27-4ec50289dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:42.217402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe639c5-5104-47d8-9b27-4ec50289dfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:42.217907 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe639c5-5104-47d8-9b27-4ec50289dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:42.218441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe639c5-5104-47d8-9b27-4ec50289dfdc admin admin] PATH_INFO: `/v3/projects/547f832c2adc4d3fb8a618390a506f3c/users/9254961d5b924330818a90ee1653aae4/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:42.229823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe639c5-5104-47d8-9b27-4ec50289dfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=547f832c2adc4d3fb8a618390a506f3c, user_id=9254961d5b924330818a90ee1653aae4, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:42.282017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe639c5-5104-47d8-9b27-4ec50289dfdc admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:42.308149 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1265/2517] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:42 2021] PUT /identity/v3/projects/547f832c2adc4d3fb8a618390a506f3c/users/9254961d5b924330818a90ee1653aae4/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:42.311917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9441b5-7072-42f1-9f70-a373cc7997f7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:42.357933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9441b5-7072-42f1-9f70-a373cc7997f7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:42.552758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32837509-b4e5-4bb0-b2ad-d3342e083685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:42.552758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32837509-b4e5-4bb0-b2ad-d3342e083685 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:42.552758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32837509-b4e5-4bb0-b2ad-d3342e083685 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:42.552758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32837509-b4e5-4bb0-b2ad-d3342e083685 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:42.554474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32837509-b4e5-4bb0-b2ad-d3342e083685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:42.585527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32837509-b4e5-4bb0-b2ad-d3342e083685 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:42.599945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1253/2518] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:42 2021] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:44:42.607077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe639c5-5104-47d8-9b27-4ec50289dfdc admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:42.621753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe639c5-5104-47d8-9b27-4ec50289dfdc admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:42.632023 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f8562-7fc1-4de5-9a8b-d2c40a29c70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:42.633465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8562-7fc1-4de5-9a8b-d2c40a29c70a admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:42.634005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8562-7fc1-4de5-9a8b-d2c40a29c70a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:42.634530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8562-7fc1-4de5-9a8b-d2c40a29c70a admin admin] PATH_INFO: `/v3/projects/547f832c2adc4d3fb8a618390a506f3c/users/9254961d5b924330818a90ee1653aae4/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:42.638566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f8562-7fc1-4de5-9a8b-d2c40a29c70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=547f832c2adc4d3fb8a618390a506f3c, user_id=9254961d5b924330818a90ee1653aae4, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:42.705684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f8562-7fc1-4de5-9a8b-d2c40a29c70a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:42.733880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1266/2519] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:42 2021] PUT /identity/v3/projects/547f832c2adc4d3fb8a618390a506f3c/users/9254961d5b924330818a90ee1653aae4/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:42.894257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32837509-b4e5-4bb0-b2ad-d3342e083685 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:42.897217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-32837509-b4e5-4bb0-b2ad-d3342e083685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:42.911713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32837509-b4e5-4bb0-b2ad-d3342e083685 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.019529 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.021040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.021582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.022188 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] PATH_INFO: `/v3/projects/bd5f98afb8994bac89739dc127d36521` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.025423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5f98afb8994bac89739dc127d36521)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:43.093107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.205041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5f98afb8994bac89739dc127d36521', 'request_id': 'req-73119bfe-20e9-4d03-a46c-9f1916a057ef'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.222920 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5f98afb8994bac89739dc127d36521', 'request_id': 'req-73119bfe-20e9-4d03-a46c-9f1916a057ef'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.233768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5f98afb8994bac89739dc127d36521', 'request_id': 'req-73119bfe-20e9-4d03-a46c-9f1916a057ef'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.250437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] The token cache is being invalidate because project bd5f98afb8994bac89739dc127d36521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:43.251093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.251990 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-73119bfe-20e9-4d03-a46c-9f1916a057ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:43.258079 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1254/2520] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:42 2021] DELETE /identity/v3/projects/bd5f98afb8994bac89739dc127d36521 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:43.262847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571884-4483-4147-8f31-15a1cbf48e75 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.263486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571884-4483-4147-8f31-15a1cbf48e75 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.263946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571884-4483-4147-8f31-15a1cbf48e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.307556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2e571884-4483-4147-8f31-15a1cbf48e75 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:43.309623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2e571884-4483-4147-8f31-15a1cbf48e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.409636 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1267/2521] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:43.419130 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d85a2b-3181-41dc-81be-9a822c6bf4cb None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.419701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d85a2b-3181-41dc-81be-9a822c6bf4cb None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.420160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d85a2b-3181-41dc-81be-9a822c6bf4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.451084 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-30d85a2b-3181-41dc-81be-9a822c6bf4cb None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:43.452446 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-30d85a2b-3181-41dc-81be-9a822c6bf4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:43.460621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1255/2522] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:43.466270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e571884-4483-4147-8f31-15a1cbf48e75 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.476914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e571884-4483-4147-8f31-15a1cbf48e75 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.483579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ab908-fc21-4e83-960c-26679db2028b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.484502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ab908-fc21-4e83-960c-26679db2028b admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.484975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ab908-fc21-4e83-960c-26679db2028b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.485424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ab908-fc21-4e83-960c-26679db2028b admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.486526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ab908-fc21-4e83-960c-26679db2028b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:44:43.487016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ab908-fc21-4e83-960c-26679db2028b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:43.537076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ab908-fc21-4e83-960c-26679db2028b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.570385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1268/2523] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:44:43.577916 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d85a2b-3181-41dc-81be-9a822c6bf4cb None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.594764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d85a2b-3181-41dc-81be-9a822c6bf4cb None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.603676 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d6faf-8257-4605-9919-070195510976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.604855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d6faf-8257-4605-9919-070195510976 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.605427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d6faf-8257-4605-9919-070195510976 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.605978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d6faf-8257-4605-9919-070195510976 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.608951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d6faf-8257-4605-9919-070195510976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:43.658991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d6faf-8257-4605-9919-070195510976 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.695794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1256/2524] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:44:43 2021] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:44:43.702289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ab908-fc21-4e83-960c-26679db2028b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.722372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ab908-fc21-4e83-960c-26679db2028b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:43.897585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f45d62-bc63-4e8a-9e3a-d9d65cbd235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:43.898714 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f45d62-bc63-4e8a-9e3a-d9d65cbd235c admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:43.899809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f45d62-bc63-4e8a-9e3a-d9d65cbd235c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:43.899809 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f45d62-bc63-4e8a-9e3a-d9d65cbd235c admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:43.900986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f45d62-bc63-4e8a-9e3a-d9d65cbd235c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:43.950456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f45d62-bc63-4e8a-9e3a-d9d65cbd235c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:43.978269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1269/2525] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:44:43 2021] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:44:43.982883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d6faf-8257-4605-9919-070195510976 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:43.994870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d6faf-8257-4605-9919-070195510976 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.000318 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ada16-b870-4a39-bde4-4e7409d558c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.000942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ada16-b870-4a39-bde4-4e7409d558c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.001238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ada16-b870-4a39-bde4-4e7409d558c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.001599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ada16-b870-4a39-bde4-4e7409d558c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.002960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ada16-b870-4a39-bde4-4e7409d558c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:44.030791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ada16-b870-4a39-bde4-4e7409d558c8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.043466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1257/2526] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:44:44.047976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f45d62-bc63-4e8a-9e3a-d9d65cbd235c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.059885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f45d62-bc63-4e8a-9e3a-d9d65cbd235c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.066840 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3fed8-ba48-4ba2-a77d-90e1ea492953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.068043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3fed8-ba48-4ba2-a77d-90e1ea492953 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.068453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3fed8-ba48-4ba2-a77d-90e1ea492953 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.069233 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3fed8-ba48-4ba2-a77d-90e1ea492953 admin admin] PATH_INFO: `/v3/projects/a2d6b781d3004fb282eed47db091b3bf/users/b7134e75e2934f78919af753f6b4e795/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.094798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3fed8-ba48-4ba2-a77d-90e1ea492953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d6b781d3004fb282eed47db091b3bf, user_id=b7134e75e2934f78919af753f6b4e795, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:44.138610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3fed8-ba48-4ba2-a77d-90e1ea492953 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.163284 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1270/2527] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:44:44 2021] PUT /identity/v3/projects/a2d6b781d3004fb282eed47db091b3bf/users/b7134e75e2934f78919af753f6b4e795/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:44:44.181132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a91aab-36b7-4828-800c-043ae0a2c9b9 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.181590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a91aab-36b7-4828-800c-043ae0a2c9b9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.182224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a91aab-36b7-4828-800c-043ae0a2c9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.285168 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b3a91aab-36b7-4828-800c-043ae0a2c9b9 None None] MFA Rules not processed for user `b7134e75e2934f78919af753f6b4e795`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:44.286390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b3a91aab-36b7-4828-800c-043ae0a2c9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:44.416242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1258/2528] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:44 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:44.447795 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3fed8-ba48-4ba2-a77d-90e1ea492953 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.450530 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4de3fed8-ba48-4ba2-a77d-90e1ea492953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:44.573754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3fed8-ba48-4ba2-a77d-90e1ea492953 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.580024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057404b2-593f-4003-9b14-aedf63805a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.581385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057404b2-593f-4003-9b14-aedf63805a63 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.582456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057404b2-593f-4003-9b14-aedf63805a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.583265 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057404b2-593f-4003-9b14-aedf63805a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.601053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057404b2-593f-4003-9b14-aedf63805a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:44.653341 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057404b2-593f-4003-9b14-aedf63805a63 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:44.668471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1271/2529] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:44 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:44.719216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a91aab-36b7-4828-800c-043ae0a2c9b9 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:44.862038 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a91aab-36b7-4828-800c-043ae0a2c9b9 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:44.868198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:44.869153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:44.869400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:44.869703 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] PATH_INFO: `/v3/users/b7134e75e2934f78919af753f6b4e795` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:44.872190 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7134e75e2934f78919af753f6b4e795)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:44.927022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:45.033809 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7134e75e2934f78919af753f6b4e795'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.057464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7134e75e2934f78919af753f6b4e795'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.071967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7134e75e2934f78919af753f6b4e795'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.072910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7134e75e2934f78919af753f6b4e795'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.087905 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7134e75e2934f78919af753f6b4e795'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:45.115339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1259/2530] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:44:44 2021] DELETE /identity/v3/users/b7134e75e2934f78919af753f6b4e795 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:45.122297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32accc28-6c08-4dc7-a7e4-9e29d6317dd7 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:45.122848 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32accc28-6c08-4dc7-a7e4-9e29d6317dd7 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:45.123433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32accc28-6c08-4dc7-a7e4-9e29d6317dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:45.239716 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-32accc28-6c08-4dc7-a7e4-9e29d6317dd7 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:45.241328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-32accc28-6c08-4dc7-a7e4-9e29d6317dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:45.353975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1272/2531] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:44:45.363907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:45.367107 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:45.520066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1e418-5237-4eba-8a55-9eb489024c9a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:45.527792 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f642e4-55bb-4a8d-ba84-03e0f633c928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:45.529771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f642e4-55bb-4a8d-ba84-03e0f633c928 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:45.529771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f642e4-55bb-4a8d-ba84-03e0f633c928 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:45.530247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f642e4-55bb-4a8d-ba84-03e0f633c928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:45.553627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f642e4-55bb-4a8d-ba84-03e0f633c928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:45.610941 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f642e4-55bb-4a8d-ba84-03e0f633c928 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:45.632875 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1260/2532] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:46.289720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32accc28-6c08-4dc7-a7e4-9e29d6317dd7 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:46.303598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-32accc28-6c08-4dc7-a7e4-9e29d6317dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:46.341352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32accc28-6c08-4dc7-a7e4-9e29d6317dd7 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:46.348296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:46.350190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:46.350648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:46.351365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] PATH_INFO: `/v3/projects/a2d6b781d3004fb282eed47db091b3bf` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:46.353798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d6b781d3004fb282eed47db091b3bf)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:46.439632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:46.543462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d6b781d3004fb282eed47db091b3bf', 'request_id': 'req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.563347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d6b781d3004fb282eed47db091b3bf', 'request_id': 'req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.575600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d6b781d3004fb282eed47db091b3bf', 'request_id': 'req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.595866 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] The token cache is being invalidate because project a2d6b781d3004fb282eed47db091b3bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:44:46.596376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.597445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:44:46.601522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1273/2533] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:44:46 2021] DELETE /identity/v3/projects/a2d6b781d3004fb282eed47db091b3bf => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:44:47.914537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40655fc-1570-4e7a-b309-7181b6c584fc None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:47.915647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40655fc-1570-4e7a-b309-7181b6c584fc None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:47.916173 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40655fc-1570-4e7a-b309-7181b6c584fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:47.943833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c40655fc-1570-4e7a-b309-7181b6c584fc None None] MFA Rules not processed for user `62521c33250d4e528a7c1edd5c0dda0b`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:47.945154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c40655fc-1570-4e7a-b309-7181b6c584fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:48.014963 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1261/2534] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:47 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:48.462939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:48.464776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:48.625577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8f6d-117d-4279-8e54-8c36e645ba0b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:48.632215 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:48.633508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:48.634055 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:48.634651 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:48.637934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:48.661184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:48.696070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:48.711752 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1274/2535] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:48 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:49.352328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40655fc-1570-4e7a-b309-7181b6c584fc None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:49.354134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c40655fc-1570-4e7a-b309-7181b6c584fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:49.485409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40655fc-1570-4e7a-b309-7181b6c584fc None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:49.493897 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2e846-0d70-436c-9ce7-2c95dbbd97d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:49.495066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2e846-0d70-436c-9ce7-2c95dbbd97d6 service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:49.495674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2e846-0d70-436c-9ce7-2c95dbbd97d6 service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:49.496249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2e846-0d70-436c-9ce7-2c95dbbd97d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:49.500163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-87c2e846-0d70-436c-9ce7-2c95dbbd97d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:49.523127 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2e846-0d70-436c-9ce7-2c95dbbd97d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:49.557755 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2e846-0d70-436c-9ce7-2c95dbbd97d6 service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:49.573178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1262/2536] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:49 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:44:49.752495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:49.754271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:49.769501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad5d85-4eba-47ed-9239-4bec2e0d10b1 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:49.775578 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:49.776618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:49.777154 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:49.777620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:49.793019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:49.814363 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:49.843029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:49.856599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1275/2537] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:49 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:44:51.363402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556c19e-54fb-4e34-90bb-a29c562eee51 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.364581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556c19e-54fb-4e34-90bb-a29c562eee51 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.364581 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556c19e-54fb-4e34-90bb-a29c562eee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.433467 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-4556c19e-54fb-4e34-90bb-a29c562eee51 None None] MFA Rules not processed for user `9254961d5b924330818a90ee1653aae4`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:51.435548 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-4556c19e-54fb-4e34-90bb-a29c562eee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:51.530449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1263/2538] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:44:51 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:51.546577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:51.548052 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:51.629038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d47553-5a96-4edc-8b38-01687d83fa70 service placement] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:51.634703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b797c99041b4e9c9cde7d0064013fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:51.635916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:51.636456 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:51.636898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:51.639926 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:51.725828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:51.769665 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:51.788896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1276/2539] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:44:51 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:44:52.026468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d389af8-eed8-418d-8f19-e9c7e6f1e77d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:52.027176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d389af8-eed8-418d-8f19-e9c7e6f1e77d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:52.028738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d389af8-eed8-418d-8f19-e9c7e6f1e77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:52.066637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-2d389af8-eed8-418d-8f19-e9c7e6f1e77d None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:44:52.068098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2d389af8-eed8-418d-8f19-e9c7e6f1e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:52.162248 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1264/2540] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:44:52 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:44:52.218610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:44:52.221119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:44:52.334224 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554b7b3-9207-4c27-9ab7-f2a8be9b33ef service glance] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:44:52.340029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca545848-70d9-44d6-a8d1-3a2d708c0656 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:44:52.340694 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca545848-70d9-44d6-a8d1-3a2d708c0656 service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:44:52.341092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca545848-70d9-44d6-a8d1-3a2d708c0656 service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:44:52.341519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca545848-70d9-44d6-a8d1-3a2d708c0656 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:44:52.352660 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca545848-70d9-44d6-a8d1-3a2d708c0656 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:44:52.393559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca545848-70d9-44d6-a8d1-3a2d708c0656 service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:44:52.404068 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1277/2541] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:44:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:45:04.386606 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d389af8-eed8-418d-8f19-e9c7e6f1e77d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:04.389229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2d389af8-eed8-418d-8f19-e9c7e6f1e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:04.621595 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d389af8-eed8-418d-8f19-e9c7e6f1e77d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:04.632495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:04.634028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:04.634777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:04.635364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:04.638755 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:04.664910 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:45:04.715283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:04.730791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1265/2542] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:04 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:07.800904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477655a9-5421-469b-b5f7-8e108afd0f9a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:07.801399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477655a9-5421-469b-b5f7-8e108afd0f9a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:07.801494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477655a9-5421-469b-b5f7-8e108afd0f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:07.826036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-477655a9-5421-469b-b5f7-8e108afd0f9a None None] MFA Rules not processed for user `a81a0ea6ec044d0a8f5f2ba192414a36`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:07.827246 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-477655a9-5421-469b-b5f7-8e108afd0f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:07.834310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1278/2543] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:45:07 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:08.393136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:08.395521 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:08.416775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e135-973c-4149-9d06-62f6a5e28ea9 service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:08.422508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247613e-bc29-4752-adab-1c58c20588b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:08.423108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247613e-bc29-4752-adab-1c58c20588b8 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:08.423394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247613e-bc29-4752-adab-1c58c20588b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:08.423891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247613e-bc29-4752-adab-1c58c20588b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:08.425648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7247613e-bc29-4752-adab-1c58c20588b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:08.437855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247613e-bc29-4752-adab-1c58c20588b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:45:08.488830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247613e-bc29-4752-adab-1c58c20588b8 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:08.506516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1266/2544] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:08 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:45:11.112983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d752-4543-4604-8338-7ed1fa4c1613 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:11.113942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d752-4543-4604-8338-7ed1fa4c1613 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:11.114166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d752-4543-4604-8338-7ed1fa4c1613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:11.155781 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c220d752-4543-4604-8338-7ed1fa4c1613 None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:11.158343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c220d752-4543-4604-8338-7ed1fa4c1613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:11.170770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1279/2545] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:45:11 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:45:11.189049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247613e-bc29-4752-adab-1c58c20588b8 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:11.210066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247613e-bc29-4752-adab-1c58c20588b8 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:11.218575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c49840-f1b3-4171-bdb6-eb4a9db69cee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:11.219542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49840-f1b3-4171-bdb6-eb4a9db69cee service swift] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:11.220019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49840-f1b3-4171-bdb6-eb4a9db69cee service swift] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:11.220507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49840-f1b3-4171-bdb6-eb4a9db69cee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:11.235761 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49840-f1b3-4171-bdb6-eb4a9db69cee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:45:11.283958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49840-f1b3-4171-bdb6-eb4a9db69cee service swift] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:11.299691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1267/2546] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:45:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:45:31.388764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220d752-4543-4604-8338-7ed1fa4c1613 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:31.388764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c220d752-4543-4604-8338-7ed1fa4c1613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:31.410987 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220d752-4543-4604-8338-7ed1fa4c1613 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:31.422688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75790cfc-29e1-448b-a559-c132dcd11132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:31.423463 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790cfc-29e1-448b-a559-c132dcd11132 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:31.424031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790cfc-29e1-448b-a559-c132dcd11132 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:31.428914 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790cfc-29e1-448b-a559-c132dcd11132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:31.431592 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-75790cfc-29e1-448b-a559-c132dcd11132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:31.448704 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75790cfc-29e1-448b-a559-c132dcd11132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:45:31.476064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75790cfc-29e1-448b-a559-c132dcd11132 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:31.490581 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1280/2547] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:31 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:45:41.496556 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1f9b9-8686-481a-8738-9b6baa6a674b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:41.497268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1f9b9-8686-481a-8738-9b6baa6a674b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:41.497268 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1f9b9-8686-481a-8738-9b6baa6a674b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:41.522422 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-e5d1f9b9-8686-481a-8738-9b6baa6a674b None None] MFA Rules not processed for user `6c6c792676f1498e98f638a268abf1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:41.523781 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e5d1f9b9-8686-481a-8738-9b6baa6a674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:41.604329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1268/2548] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:45:41 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:51.847273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f635c5-3e7b-4fda-a175-26fe4b3cdf06 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:51.848051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f635c5-3e7b-4fda-a175-26fe4b3cdf06 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:51.848237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f635c5-3e7b-4fda-a175-26fe4b3cdf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:51.883174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f7f635c5-3e7b-4fda-a175-26fe4b3cdf06 None None] MFA Rules not processed for user `0d72966786b641f48edda655d2d0ba45`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:45:51.884499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f7f635c5-3e7b-4fda-a175-26fe4b3cdf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:51.970436 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1281/2549] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:45:51 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:45:53.989331 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1f9b9-8686-481a-8738-9b6baa6a674b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:45:54.005764 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1f9b9-8686-481a-8738-9b6baa6a674b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:45:54.015625 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a65c2-fa00-4086-be36-187245436d44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:45:54.016860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a65c2-fa00-4086-be36-187245436d44 service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:45:54.017806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a65c2-fa00-4086-be36-187245436d44 service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:45:54.018393 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a65c2-fa00-4086-be36-187245436d44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:45:54.024101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-ff8a65c2-fa00-4086-be36-187245436d44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:45:54.042578 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a65c2-fa00-4086-be36-187245436d44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:45:54.079421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a65c2-fa00-4086-be36-187245436d44 service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:45:54.094740 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1269/2550] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:45:53 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:46:05.300168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f635c5-3e7b-4fda-a175-26fe4b3cdf06 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:05.312479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f635c5-3e7b-4fda-a175-26fe4b3cdf06 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:05.316684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1b269-ddb0-42a7-8933-02aa4f7f3df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:05.317379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1b269-ddb0-42a7-8933-02aa4f7f3df4 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:05.317741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1b269-ddb0-42a7-8933-02aa4f7f3df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:05.318058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1b269-ddb0-42a7-8933-02aa4f7f3df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:05.328742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1b269-ddb0-42a7-8933-02aa4f7f3df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:46:05.355652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1b269-ddb0-42a7-8933-02aa4f7f3df4 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:05.366059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1282/2551] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:46:05 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:46:16.554995 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a65c2-fa00-4086-be36-187245436d44 service placement] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:16.572778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a65c2-fa00-4086-be36-187245436d44 service placement] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:16.581289 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eafb12-ff16-4db4-897c-965c6ad92119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:16.581896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eafb12-ff16-4db4-897c-965c6ad92119 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:16.582319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eafb12-ff16-4db4-897c-965c6ad92119 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:16.582631 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eafb12-ff16-4db4-897c-965c6ad92119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:16.584435 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-86eafb12-ff16-4db4-897c-965c6ad92119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:16.668503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eafb12-ff16-4db4-897c-965c6ad92119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:46:16.697774 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eafb12-ff16-4db4-897c-965c6ad92119 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:16.709049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1270/2552] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:46:16 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:46:27.192040 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1b269-ddb0-42a7-8933-02aa4f7f3df4 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:27.194259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8df1b269-ddb0-42a7-8933-02aa4f7f3df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:46:27.293913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1b269-ddb0-42a7-8933-02aa4f7f3df4 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:27.299440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:27.300298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:27.300617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:27.300876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] PATH_INFO: `/v3/users/62521c33250d4e528a7c1edd5c0dda0b` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:27.302222 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62521c33250d4e528a7c1edd5c0dda0b)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:46:27.328898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:27.387044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62521c33250d4e528a7c1edd5c0dda0b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:27.395687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62521c33250d4e528a7c1edd5c0dda0b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:27.396413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62521c33250d4e528a7c1edd5c0dda0b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:27.405671 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62521c33250d4e528a7c1edd5c0dda0b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:27.420136 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62521c33250d4e528a7c1edd5c0dda0b'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:27.427509 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1283/2553] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:46:27 2021] DELETE /identity/v3/users/62521c33250d4e528a7c1edd5c0dda0b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:46:27.773300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eafb12-ff16-4db4-897c-965c6ad92119 service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:46:27.785430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eafb12-ff16-4db4-897c-965c6ad92119 service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:46:27.862896 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:46:27.863742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:46:27.864026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:46:27.864303 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] PATH_INFO: `/v3/projects/841e959321694bbe969318fafd7f676b` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:46:27.866335 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=841e959321694bbe969318fafd7f676b)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:46:27.892406 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:46:27.967226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841e959321694bbe969318fafd7f676b', 'request_id': 'req-829e7e00-5b4d-4112-b752-09507345cd60'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:27.981031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841e959321694bbe969318fafd7f676b', 'request_id': 'req-829e7e00-5b4d-4112-b752-09507345cd60'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:27.991343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841e959321694bbe969318fafd7f676b', 'request_id': 'req-829e7e00-5b4d-4112-b752-09507345cd60'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:28.003537 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] The token cache is being invalidate because project 841e959321694bbe969318fafd7f676b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:46:28.003822 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:28.004821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:46:28.006336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1271/2554] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:46:27 2021] DELETE /identity/v3/projects/841e959321694bbe969318fafd7f676b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:47:45.991211 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:45.992776 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:46.075541 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b3543-dd85-41c3-ba2c-cd69c081ab78 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:46.140702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087285f-402d-4f17-a057-9da009c95b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:46.141314 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087285f-402d-4f17-a057-9da009c95b1a service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:46.141747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087285f-402d-4f17-a057-9da009c95b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:46.142095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087285f-402d-4f17-a057-9da009c95b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:46.143883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c087285f-402d-4f17-a057-9da009c95b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:46.229473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087285f-402d-4f17-a057-9da009c95b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:47:46.255700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087285f-402d-4f17-a057-9da009c95b1a service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:46.267797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1284/2555] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:47:45 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:47:52.349614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:52.351204 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:52.418240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e7e00-5b4d-4112-b752-09507345cd60 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:52.422410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b797c99041b4e9c9cde7d0064013fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:52.423006 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:52.423291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:52.423565 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:52.425464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:52.439796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:47:52.465514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:52.477192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1272/2556] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:47:52 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:47:55.254856 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087285f-402d-4f17-a057-9da009c95b1a service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:47:55.267092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087285f-402d-4f17-a057-9da009c95b1a service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:47:55.273602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32397fbe-130d-4db2-bb21-29b97bc86f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:47:55.274276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32397fbe-130d-4db2-bb21-29b97bc86f10 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:47:55.274559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32397fbe-130d-4db2-bb21-29b97bc86f10 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:47:55.274847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32397fbe-130d-4db2-bb21-29b97bc86f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:47:55.276759 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-32397fbe-130d-4db2-bb21-29b97bc86f10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:47:55.397128 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32397fbe-130d-4db2-bb21-29b97bc86f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:47:55.431613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32397fbe-130d-4db2-bb21-29b97bc86f10 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:47:55.453763 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1285/2557] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:47:55 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:11.545601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:11.546996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:11.620005 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378d884-9d08-4e47-9cf3-69ab185363c1 service glance] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:11.625353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:11.626147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:11.626584 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:11.627060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:11.629519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:11.726758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:11.754032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:11.766265 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1273/2558] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:48:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:15.359577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb236e-51f3-4b55-8466-3067fbe9829f None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:15.360439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb236e-51f3-4b55-8466-3067fbe9829f None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:15.360439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb236e-51f3-4b55-8466-3067fbe9829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:15.391812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2ebb236e-51f3-4b55-8466-3067fbe9829f None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:48:15.394474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2ebb236e-51f3-4b55-8466-3067fbe9829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:15.672655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1286/2559] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:48:15 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:48:15.757684 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:15.760348 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:15.863424 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f049e7-fcd0-409d-8bf0-0c26fa085863 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:15.868371 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a131ca-cd20-494f-b7e2-640b981c690c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:15.869120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a131ca-cd20-494f-b7e2-640b981c690c service swift] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:15.869502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a131ca-cd20-494f-b7e2-640b981c690c service swift] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:15.869891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a131ca-cd20-494f-b7e2-640b981c690c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:15.881384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a131ca-cd20-494f-b7e2-640b981c690c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:15.910652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a131ca-cd20-494f-b7e2-640b981c690c service swift] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:15.921209 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1274/2560] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:48:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:48:20.401113 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb236e-51f3-4b55-8466-3067fbe9829f None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:20.403228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2ebb236e-51f3-4b55-8466-3067fbe9829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:20.435543 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb236e-51f3-4b55-8466-3067fbe9829f None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:20.453476 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:20.456088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:20.457445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:20.457948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] PATH_INFO: `/v3/users/6c6c792676f1498e98f638a268abf1e5` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:20.503488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6c792676f1498e98f638a268abf1e5)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:20.560983 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:20.663398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6c792676f1498e98f638a268abf1e5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:20.681487 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6c792676f1498e98f638a268abf1e5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:20.681487 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6c792676f1498e98f638a268abf1e5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:20.686069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6c792676f1498e98f638a268abf1e5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:20.703726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-89036b74-dac4-4d25-a984-f61ca1385c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6c792676f1498e98f638a268abf1e5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:20.715008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1287/2561] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:48:20 2021] DELETE /identity/v3/users/6c6c792676f1498e98f638a268abf1e5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:48:21.116245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a131ca-cd20-494f-b7e2-640b981c690c service swift] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:21.140655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a131ca-cd20-494f-b7e2-640b981c690c service swift] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:21.290325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:21.292555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:21.293541 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:21.294400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] PATH_INFO: `/v3/projects/f78091827c644b1fb185ec17f9aa73e2` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:21.320030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78091827c644b1fb185ec17f9aa73e2)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:21.378897 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:21.460255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78091827c644b1fb185ec17f9aa73e2', 'request_id': 'req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:21.485739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78091827c644b1fb185ec17f9aa73e2', 'request_id': 'req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:21.500262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78091827c644b1fb185ec17f9aa73e2', 'request_id': 'req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:21.524283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] The token cache is being invalidate because project f78091827c644b1fb185ec17f9aa73e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:48:21.524918 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:21.526163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-99a5fc14-f320-4d0f-8fc4-9ec0827df5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:48:21.535402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1275/2562] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:48:21 2021] DELETE /identity/v3/projects/f78091827c644b1fb185ec17f9aa73e2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:48:21.538405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e269-db0e-4cb5-8aa7-ea20958a636b None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:21.539007 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e269-db0e-4cb5-8aa7-ea20958a636b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:21.539408 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e269-db0e-4cb5-8aa7-ea20958a636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:21.578455 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2e73e269-db0e-4cb5-8aa7-ea20958a636b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:48:21.579826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2e73e269-db0e-4cb5-8aa7-ea20958a636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:21.682207 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1288/2563] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:48:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:48:21.685859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe6818-fa5e-4eac-b1a1-db39e6401e1b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:21.686229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe6818-fa5e-4eac-b1a1-db39e6401e1b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:21.686473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe6818-fa5e-4eac-b1a1-db39e6401e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:21.714507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-3fbe6818-fa5e-4eac-b1a1-db39e6401e1b None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:48:21.715749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-3fbe6818-fa5e-4eac-b1a1-db39e6401e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:21.724380 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1276/2564] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:48:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:48:21.729261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e269-db0e-4cb5-8aa7-ea20958a636b None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:21.748028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e269-db0e-4cb5-8aa7-ea20958a636b None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:21.756380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2bc01-929e-40d8-a0f1-f4c6f5f6011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:21.757931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2bc01-929e-40d8-a0f1-f4c6f5f6011a admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:21.758617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2bc01-929e-40d8-a0f1-f4c6f5f6011a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:21.759369 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2bc01-929e-40d8-a0f1-f4c6f5f6011a admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:21.761243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2bc01-929e-40d8-a0f1-f4c6f5f6011a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:48:21.761819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2bc01-929e-40d8-a0f1-f4c6f5f6011a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:21.801422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2bc01-929e-40d8-a0f1-f4c6f5f6011a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:21.830424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1289/2565] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:48:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:48:21.833457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe6818-fa5e-4eac-b1a1-db39e6401e1b None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:21.845579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe6818-fa5e-4eac-b1a1-db39e6401e1b None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:21.850519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25dd32-fe62-41af-8a19-a4dbf93930a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:21.851392 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25dd32-fe62-41af-8a19-a4dbf93930a0 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:21.853066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25dd32-fe62-41af-8a19-a4dbf93930a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:21.853751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25dd32-fe62-41af-8a19-a4dbf93930a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:21.854754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25dd32-fe62-41af-8a19-a4dbf93930a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:21.907493 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25dd32-fe62-41af-8a19-a4dbf93930a0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:21.971998 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1277/2566] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:48:21 2021] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:48:21.974103 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2bc01-929e-40d8-a0f1-f4c6f5f6011a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:21.994805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2bc01-929e-40d8-a0f1-f4c6f5f6011a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:22.155745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082af673-eff1-48b4-b5d5-1492c5cc921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:22.156552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082af673-eff1-48b4-b5d5-1492c5cc921d admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:22.157021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082af673-eff1-48b4-b5d5-1492c5cc921d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:22.157573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082af673-eff1-48b4-b5d5-1492c5cc921d admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:22.159614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082af673-eff1-48b4-b5d5-1492c5cc921d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:22.206065 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082af673-eff1-48b4-b5d5-1492c5cc921d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:22.246435 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1290/2567] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:48:21 2021] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:48:22.249098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25dd32-fe62-41af-8a19-a4dbf93930a0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:22.275046 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25dd32-fe62-41af-8a19-a4dbf93930a0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:22.287029 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a214a-375f-41e5-ab3f-1f220bcc8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:22.287332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a214a-375f-41e5-ab3f-1f220bcc8c0b admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:22.288179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a214a-375f-41e5-ab3f-1f220bcc8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:22.288466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a214a-375f-41e5-ab3f-1f220bcc8c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:22.289370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a214a-375f-41e5-ab3f-1f220bcc8c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:22.329200 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a214a-375f-41e5-ab3f-1f220bcc8c0b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:22.344328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1278/2568] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:48:22 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:48:22.346627 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082af673-eff1-48b4-b5d5-1492c5cc921d admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:22.365501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082af673-eff1-48b4-b5d5-1492c5cc921d admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:22.370524 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ffa67-8ad3-41b1-8c69-3549317a3a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:22.371454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ffa67-8ad3-41b1-8c69-3549317a3a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:22.371807 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ffa67-8ad3-41b1-8c69-3549317a3a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:22.372259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ffa67-8ad3-41b1-8c69-3549317a3a2a admin admin] PATH_INFO: `/v3/projects/eb6df6b44f0d42339c2fd1095ce3bdf9/users/9a05ec0df9334b0ca96bffdd9fdfe99d/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:22.400051 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ffa67-8ad3-41b1-8c69-3549317a3a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6df6b44f0d42339c2fd1095ce3bdf9, user_id=9a05ec0df9334b0ca96bffdd9fdfe99d, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:22.429452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ffa67-8ad3-41b1-8c69-3549317a3a2a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:22.447706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1291/2569] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:48:22 2021] PUT /identity/v3/projects/eb6df6b44f0d42339c2fd1095ce3bdf9/users/9a05ec0df9334b0ca96bffdd9fdfe99d/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:48:22.456257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28295-644a-4384-9ae8-feae7c19ad65 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:22.456815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28295-644a-4384-9ae8-feae7c19ad65 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:22.457322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28295-644a-4384-9ae8-feae7c19ad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:22.486712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-95f28295-644a-4384-9ae8-feae7c19ad65 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:48:22.488008 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-95f28295-644a-4384-9ae8-feae7c19ad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:22.596693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1279/2570] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:48:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:48:22.612870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ffa67-8ad3-41b1-8c69-3549317a3a2a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:22.616046 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-167ffa67-8ad3-41b1-8c69-3549317a3a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:22.736259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ffa67-8ad3-41b1-8c69-3549317a3a2a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:22.740433 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e714f40-1a68-43ac-bb27-ec489d929a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:22.741282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e714f40-1a68-43ac-bb27-ec489d929a25 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:22.741758 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e714f40-1a68-43ac-bb27-ec489d929a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:22.742067 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e714f40-1a68-43ac-bb27-ec489d929a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:22.752895 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e714f40-1a68-43ac-bb27-ec489d929a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:22.778949 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e714f40-1a68-43ac-bb27-ec489d929a25 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:22.790162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1292/2571] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:48:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:24.000296 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329fce0-2410-4deb-a262-9f45f627ff93 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:24.001299 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329fce0-2410-4deb-a262-9f45f627ff93 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:24.001841 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329fce0-2410-4deb-a262-9f45f627ff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:24.075793 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5329fce0-2410-4deb-a262-9f45f627ff93 None None] MFA Rules not processed for user `9a05ec0df9334b0ca96bffdd9fdfe99d`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:48:24.077353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5329fce0-2410-4deb-a262-9f45f627ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:24.232386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1280/2572] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:48:23 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:48:24.246941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978d34-eca4-43e9-ac60-2d809f03732d None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:24.247598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978d34-eca4-43e9-ac60-2d809f03732d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:24.247598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978d34-eca4-43e9-ac60-2d809f03732d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:24.276893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-36978d34-eca4-43e9-ac60-2d809f03732d None None] MFA Rules not processed for user `9a05ec0df9334b0ca96bffdd9fdfe99d`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:48:24.278262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-36978d34-eca4-43e9-ac60-2d809f03732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:24.286639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1293/2573] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:48:24 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:48:24.309869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329fce0-2410-4deb-a262-9f45f627ff93 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:24.312075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5329fce0-2410-4deb-a262-9f45f627ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:24.509832 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329fce0-2410-4deb-a262-9f45f627ff93 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:24.523805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40451129-9d4b-4a09-89b7-b860f220dcfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:24.524808 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40451129-9d4b-4a09-89b7-b860f220dcfd service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:24.525237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40451129-9d4b-4a09-89b7-b860f220dcfd service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:24.525758 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40451129-9d4b-4a09-89b7-b860f220dcfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:24.548937 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40451129-9d4b-4a09-89b7-b860f220dcfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:24.615702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40451129-9d4b-4a09-89b7-b860f220dcfd service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:24.651763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1281/2574] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:48:24 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:28.663487 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36978d34-eca4-43e9-ac60-2d809f03732d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:28.665556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-36978d34-eca4-43e9-ac60-2d809f03732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:28.679287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36978d34-eca4-43e9-ac60-2d809f03732d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:28.684705 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a523f48-0fad-498b-908c-98057bf12c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:28.686042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523f48-0fad-498b-908c-98057bf12c0e service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:28.686862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523f48-0fad-498b-908c-98057bf12c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:28.687483 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523f48-0fad-498b-908c-98057bf12c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:28.690936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8a523f48-0fad-498b-908c-98057bf12c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:28.709399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a523f48-0fad-498b-908c-98057bf12c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:28.766290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a523f48-0fad-498b-908c-98057bf12c0e service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:28.781674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1294/2575] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:48:28 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:48:35.385967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0e78e-675e-4ec3-ab6f-a9bb4eb8f7be None None] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:35.386604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0e78e-675e-4ec3-ab6f-a9bb4eb8f7be None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:35.387374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0e78e-675e-4ec3-ab6f-a9bb4eb8f7be None None] PATH_INFO: `/` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:35.390438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1282/2576] 10.222.0.67 () {54 vars in 921 bytes} [Thu Dec 16 14:48:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:48:35.397324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84451947-abeb-472a-a296-97df4ab7b2ab None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:35.398486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84451947-abeb-472a-a296-97df4ab7b2ab None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:35.399025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84451947-abeb-472a-a296-97df4ab7b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:35.467434 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-84451947-abeb-472a-a296-97df4ab7b2ab None None] MFA Rules not processed for user `20905ef1afa847bc8f2f6f6e335f8bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:48:35.469942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-84451947-abeb-472a-a296-97df4ab7b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:35.482182 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1295/2577] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Dec 16 14:48:35 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:48:35.492417 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0e78e-675e-4ec3-ab6f-a9bb4eb8f7be None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:35.504403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0e78e-675e-4ec3-ab6f-a9bb4eb8f7be None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:35.508117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e441c49-9758-4c04-afea-00187421545f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:35.509057 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e441c49-9758-4c04-afea-00187421545f service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:35.509447 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e441c49-9758-4c04-afea-00187421545f service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:35.510022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e441c49-9758-4c04-afea-00187421545f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:35.519623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e441c49-9758-4c04-afea-00187421545f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:35.546530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e441c49-9758-4c04-afea-00187421545f service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:35.557724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1283/2578] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:48:35 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:38.466822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2a18c-69cc-452f-95da-a16e42289a99 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:38.467393 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2a18c-69cc-452f-95da-a16e42289a99 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:38.467778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2a18c-69cc-452f-95da-a16e42289a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:38.505224 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2ba2a18c-69cc-452f-95da-a16e42289a99 None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:48:38.507909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2ba2a18c-69cc-452f-95da-a16e42289a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:38.628515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1296/2579] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:48:38 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:48:38.644734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e441c49-9758-4c04-afea-00187421545f service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:38.646991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6e441c49-9758-4c04-afea-00187421545f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:38.758154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e441c49-9758-4c04-afea-00187421545f service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:38.763873 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7cdbe-428e-462f-9d7a-c939aeadf228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:38.764528 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7cdbe-428e-462f-9d7a-c939aeadf228 service swift] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:38.765328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7cdbe-428e-462f-9d7a-c939aeadf228 service swift] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:38.765746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7cdbe-428e-462f-9d7a-c939aeadf228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:38.775800 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7cdbe-428e-462f-9d7a-c939aeadf228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:38.806794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7cdbe-428e-462f-9d7a-c939aeadf228 service swift] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:38.819719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1284/2580] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:48:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:48:58.938897 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2a18c-69cc-452f-95da-a16e42289a99 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:48:58.948700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2a18c-69cc-452f-95da-a16e42289a99 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:48:58.952966 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91156-db49-4915-8945-3c837a6b2cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:48:58.953768 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91156-db49-4915-8945-3c837a6b2cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:48:58.954184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91156-db49-4915-8945-3c837a6b2cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:48:58.954478 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91156-db49-4915-8945-3c837a6b2cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:48:58.956712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-e0a91156-db49-4915-8945-3c837a6b2cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:48:58.970273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a91156-db49-4915-8945-3c837a6b2cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:48:59.004081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a91156-db49-4915-8945-3c837a6b2cf6 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:48:59.015118 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1297/2581] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:48:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:49:04.780433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35886b-7d66-463f-9ba3-f4ae2a4eb166 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:04.781706 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35886b-7d66-463f-9ba3-f4ae2a4eb166 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:04.782519 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35886b-7d66-463f-9ba3-f4ae2a4eb166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:04.820959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-2e35886b-7d66-463f-9ba3-f4ae2a4eb166 None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:04.822530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2e35886b-7d66-463f-9ba3-f4ae2a4eb166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:04.834405 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1285/2582] 10.222.0.67 () {58 vars in 967 bytes} [Thu Dec 16 14:49:04 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:49:04.841937 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91156-db49-4915-8945-3c837a6b2cf6 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:04.854171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91156-db49-4915-8945-3c837a6b2cf6 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:04.862846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11b22-ea3c-4d03-b8e6-b5309c95132e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:04.864889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11b22-ea3c-4d03-b8e6-b5309c95132e service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:04.865782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11b22-ea3c-4d03-b8e6-b5309c95132e service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:04.866081 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11b22-ea3c-4d03-b8e6-b5309c95132e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:04.876967 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11b22-ea3c-4d03-b8e6-b5309c95132e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:04.907610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11b22-ea3c-4d03-b8e6-b5309c95132e service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:04.920301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1298/2583] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:49:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:49:05.603196 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f49f9-2842-424e-a2b9-a8ecd1c655fa None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:05.603488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f49f9-2842-424e-a2b9-a8ecd1c655fa None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:05.604048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f49f9-2842-424e-a2b9-a8ecd1c655fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:05.633257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-527f49f9-2842-424e-a2b9-a8ecd1c655fa None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:05.636915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-527f49f9-2842-424e-a2b9-a8ecd1c655fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:05.664015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1286/2584] 10.222.0.67 () {58 vars in 967 bytes} [Thu Dec 16 14:49:05 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:49:05.667037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11b22-ea3c-4d03-b8e6-b5309c95132e service swift] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:05.680278 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11b22-ea3c-4d03-b8e6-b5309c95132e service swift] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:05.687501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde251c7-4cbe-42ef-ba92-b9b0ea9495dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:05.688450 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde251c7-4cbe-42ef-ba92-b9b0ea9495dd service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:05.688961 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde251c7-4cbe-42ef-ba92-b9b0ea9495dd service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:05.689421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde251c7-4cbe-42ef-ba92-b9b0ea9495dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:05.699679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde251c7-4cbe-42ef-ba92-b9b0ea9495dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:05.725778 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde251c7-4cbe-42ef-ba92-b9b0ea9495dd service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:05.756375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1299/2585] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:49:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:49:08.415826 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b2903-46e3-4f6c-a577-b890e69ff7b1 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:08.416853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b2903-46e3-4f6c-a577-b890e69ff7b1 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:08.417344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b2903-46e3-4f6c-a577-b890e69ff7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:08.440691 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-763b2903-46e3-4f6c-a577-b890e69ff7b1 None None] MFA Rules not processed for user `9a05ec0df9334b0ca96bffdd9fdfe99d`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:08.442048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-763b2903-46e3-4f6c-a577-b890e69ff7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:08.458468 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1287/2586] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:49:08 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:49:18.141891 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde251c7-4cbe-42ef-ba92-b9b0ea9495dd service swift] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:18.146034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-dde251c7-4cbe-42ef-ba92-b9b0ea9495dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:18.182154 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde251c7-4cbe-42ef-ba92-b9b0ea9495dd service swift] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:18.191859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:18.193495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:18.194220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:18.197088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] PATH_INFO: `/v3/users/60acaee6050143099c2ded8515eab3d3` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:18.199461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60acaee6050143099c2ded8515eab3d3)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:18.276166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:18.359909 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60acaee6050143099c2ded8515eab3d3'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.369859 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60acaee6050143099c2ded8515eab3d3'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.370864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60acaee6050143099c2ded8515eab3d3'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.382755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60acaee6050143099c2ded8515eab3d3'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.396674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60acaee6050143099c2ded8515eab3d3'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.403165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1300/2587] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:49:18 2021] DELETE /identity/v3/users/60acaee6050143099c2ded8515eab3d3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:18.656996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b2903-46e3-4f6c-a577-b890e69ff7b1 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:18.670772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b2903-46e3-4f6c-a577-b890e69ff7b1 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:18.749263 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:18.750217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:18.750511 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:18.750982 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] PATH_INFO: `/v3/projects/9a687d83941a46d8893bb58f302b2951` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:18.752198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a687d83941a46d8893bb58f302b2951)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:18.779072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:18.839421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a687d83941a46d8893bb58f302b2951', 'request_id': 'req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.851723 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a687d83941a46d8893bb58f302b2951', 'request_id': 'req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.860601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a687d83941a46d8893bb58f302b2951', 'request_id': 'req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.875142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] The token cache is being invalidate because project 9a687d83941a46d8893bb58f302b2951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:49:18.875461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.876106 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:18.877714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1288/2588] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:49:18 2021] DELETE /identity/v3/projects/9a687d83941a46d8893bb58f302b2951 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:49:18.882501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:18.884129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:18.897324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c231ea-ad86-41f5-80b0-ec531b9e6876 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:19.014752 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:19.015486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:19.015772 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:19.016047 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] PATH_INFO: `/v3/users/6277cfcd4a084454ab52b5efd15c2dcb` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:19.017253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6277cfcd4a084454ab52b5efd15c2dcb)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:19.046162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:19.117107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6277cfcd4a084454ab52b5efd15c2dcb'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.127505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6277cfcd4a084454ab52b5efd15c2dcb'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.129059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6277cfcd4a084454ab52b5efd15c2dcb'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.140743 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6277cfcd4a084454ab52b5efd15c2dcb'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.158116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6277cfcd4a084454ab52b5efd15c2dcb'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.166189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1301/2589] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:49:18 2021] DELETE /identity/v3/users/6277cfcd4a084454ab52b5efd15c2dcb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:49:19.417339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:19.419369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:19.443295 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb5e2-d49e-4b0f-8cf9-6b2a10d5e54a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:19.517644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:19.518641 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:19.519002 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:19.519403 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] PATH_INFO: `/v3/projects/bb99884353fe4454bb8d173478d35434` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:19.520610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb99884353fe4454bb8d173478d35434)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:19.546601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:19.600438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb99884353fe4454bb8d173478d35434', 'request_id': 'req-9c196605-f485-4373-b5b0-fc5bc30e0f55'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.612763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb99884353fe4454bb8d173478d35434', 'request_id': 'req-9c196605-f485-4373-b5b0-fc5bc30e0f55'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.623389 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb99884353fe4454bb8d173478d35434', 'request_id': 'req-9c196605-f485-4373-b5b0-fc5bc30e0f55'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.636951 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] The token cache is being invalidate because project bb99884353fe4454bb8d173478d35434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:49:19.637690 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.638530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:19.640327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1289/2590] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:49:19 2021] DELETE /identity/v3/projects/bb99884353fe4454bb8d173478d35434 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:49:23.931977 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:23.933641 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:23.952087 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c1843-c152-4402-a57c-f6e2734e8f9e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:24.045142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:24.046610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:24.046903 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:24.047200 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] PATH_INFO: `/v3/users/a81a0ea6ec044d0a8f5f2ba192414a36` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:24.054028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81a0ea6ec044d0a8f5f2ba192414a36)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:24.085964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:24.156986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81a0ea6ec044d0a8f5f2ba192414a36'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.166996 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81a0ea6ec044d0a8f5f2ba192414a36'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.167984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81a0ea6ec044d0a8f5f2ba192414a36'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.180481 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81a0ea6ec044d0a8f5f2ba192414a36'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.194886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81a0ea6ec044d0a8f5f2ba192414a36'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.210011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1302/2591] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:49:23 2021] DELETE /identity/v3/users/a81a0ea6ec044d0a8f5f2ba192414a36 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:24.469971 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:24.471756 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:24.486117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c196605-f485-4373-b5b0-fc5bc30e0f55 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:24.557027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:24.557830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:24.558160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:24.558442 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] PATH_INFO: `/v3/projects/7210fc0bdd80446484aaf7f436c2317b` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:24.559507 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7210fc0bdd80446484aaf7f436c2317b)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:24.585458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:24.641893 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7210fc0bdd80446484aaf7f436c2317b', 'request_id': 'req-22464940-f9e0-4aaa-b981-81d84a6d4dbd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.653422 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7210fc0bdd80446484aaf7f436c2317b', 'request_id': 'req-22464940-f9e0-4aaa-b981-81d84a6d4dbd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.662402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7210fc0bdd80446484aaf7f436c2317b', 'request_id': 'req-22464940-f9e0-4aaa-b981-81d84a6d4dbd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.673807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] The token cache is being invalidate because project 7210fc0bdd80446484aaf7f436c2317b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:49:24.674059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.674719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.676207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1290/2592] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:49:24 2021] DELETE /identity/v3/projects/7210fc0bdd80446484aaf7f436c2317b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:24.680385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:24.681833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:24.694390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735c0f8-0f69-45c8-853e-a7873b88935b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:24.767646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:24.768411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:24.768727 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:24.768984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] PATH_INFO: `/v3/users/9254961d5b924330818a90ee1653aae4` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:24.770168 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9254961d5b924330818a90ee1653aae4)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:24.795979 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:24.853598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9254961d5b924330818a90ee1653aae4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.861788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9254961d5b924330818a90ee1653aae4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.862566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9254961d5b924330818a90ee1653aae4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.872462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9254961d5b924330818a90ee1653aae4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.884766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-6c9e76e7-556f-408f-930d-f6a2f6df6934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9254961d5b924330818a90ee1653aae4'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:24.890905 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1303/2593] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:49:24 2021] DELETE /identity/v3/users/9254961d5b924330818a90ee1653aae4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:25.143940 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:25.145649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:25.161134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464940-f9e0-4aaa-b981-81d84a6d4dbd admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:25.317325 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:25.318115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:25.318405 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:25.318682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] PATH_INFO: `/v3/projects/547f832c2adc4d3fb8a618390a506f3c` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:25.319845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=547f832c2adc4d3fb8a618390a506f3c)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:25.345785 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:25.409456 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547f832c2adc4d3fb8a618390a506f3c', 'request_id': 'req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:25.422035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547f832c2adc4d3fb8a618390a506f3c', 'request_id': 'req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:25.432064 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547f832c2adc4d3fb8a618390a506f3c', 'request_id': 'req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:25.444465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] The token cache is being invalidate because project 547f832c2adc4d3fb8a618390a506f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:49:25.444741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:25.445423 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:49:25.447053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1291/2594] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:49:25 2021] DELETE /identity/v3/projects/547f832c2adc4d3fb8a618390a506f3c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:49:33.838012 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509db12c-9ebe-4bc0-9f81-289ed49e0a1b None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:33.838600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509db12c-9ebe-4bc0-9f81-289ed49e0a1b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:33.838600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509db12c-9ebe-4bc0-9f81-289ed49e0a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:33.874726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-509db12c-9ebe-4bc0-9f81-289ed49e0a1b None None] MFA Rules not processed for user `9a05ec0df9334b0ca96bffdd9fdfe99d`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:49:33.875988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-509db12c-9ebe-4bc0-9f81-289ed49e0a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:33.940426 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1304/2595] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:49:33 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:49:38.355877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:49:38.358584 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:38.545646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceadab-5e3a-4f16-8d7c-8c59a065d21b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:49:38.551134 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:49:38.551738 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:49:38.552028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:49:38.552301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:49:38.554049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:49:38.566291 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:49:38.592853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:49:38.604153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1292/2596] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:49:38 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:01.055435 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08960be7-a8cd-45bd-aa6f-3a1073fc93c0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:01.056138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08960be7-a8cd-45bd-aa6f-3a1073fc93c0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:01.056138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08960be7-a8cd-45bd-aa6f-3a1073fc93c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:01.080417 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-08960be7-a8cd-45bd-aa6f-3a1073fc93c0 None None] MFA Rules not processed for user `9a05ec0df9334b0ca96bffdd9fdfe99d`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:01.081726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-08960be7-a8cd-45bd-aa6f-3a1073fc93c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:01.088764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1305/2597] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:01 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:50:01.876230 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:01.877742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:02.000355 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801adee-4dcf-41ab-b1dd-99162534f55f service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:02.005512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:02.006234 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:02.006524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:02.006803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:02.008591 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:02.020305 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:02.046016 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:02.056765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1293/2598] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:01 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:02.174672 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08960be7-a8cd-45bd-aa6f-3a1073fc93c0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:02.176329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-08960be7-a8cd-45bd-aa6f-3a1073fc93c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:02.190709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08960be7-a8cd-45bd-aa6f-3a1073fc93c0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:02.195797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f522d8-a79f-42a2-83df-a1c5dd6c5f64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:02.196376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f522d8-a79f-42a2-83df-a1c5dd6c5f64 service placement] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:02.196658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f522d8-a79f-42a2-83df-a1c5dd6c5f64 service placement] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:02.196943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f522d8-a79f-42a2-83df-a1c5dd6c5f64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:02.198703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-64f522d8-a79f-42a2-83df-a1c5dd6c5f64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:02.210424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f522d8-a79f-42a2-83df-a1c5dd6c5f64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:02.236537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f522d8-a79f-42a2-83df-a1c5dd6c5f64 service placement] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:02.247287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1306/2599] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:02 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:13.523028 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:13.524821 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:13.540935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e499166-e12c-4cc6-9fd0-cd0e30e9499d service placement] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:13.546391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:13.547071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:13.547353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:13.547629 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:13.549430 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:13.562384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:13.589350 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:13.601214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1294/2600] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:13 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:42.849322 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f522d8-a79f-42a2-83df-a1c5dd6c5f64 service placement] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:42.870965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f522d8-a79f-42a2-83df-a1c5dd6c5f64 service placement] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:42.882015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c02bb7-2db8-49e4-98db-1686b5eab436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:42.883459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02bb7-2db8-49e4-98db-1686b5eab436 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:42.884028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02bb7-2db8-49e4-98db-1686b5eab436 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:42.884542 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02bb7-2db8-49e4-98db-1686b5eab436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:42.886858 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-61c02bb7-2db8-49e4-98db-1686b5eab436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:42.915734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c02bb7-2db8-49e4-98db-1686b5eab436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:42.952394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c02bb7-2db8-49e4-98db-1686b5eab436 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:42.966397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1307/2601] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:42 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:48.339513 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:48.340960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:48.436538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eeb4b-e1c3-444d-b621-7dfc40656758 service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:48.440066 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:48.440649 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:48.440938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:48.441210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:48.443007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:48.543138 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:48.569367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:48.592340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1295/2602] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:53.259689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c02bb7-2db8-49e4-98db-1686b5eab436 service nova] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:53.322857 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c02bb7-2db8-49e4-98db-1686b5eab436 service nova] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:53.331609 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383d5d1-290d-4855-8aa3-95adf0fdf45d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:53.332652 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383d5d1-290d-4855-8aa3-95adf0fdf45d service placement] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:53.333158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383d5d1-290d-4855-8aa3-95adf0fdf45d service placement] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:53.333692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383d5d1-290d-4855-8aa3-95adf0fdf45d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:53.337290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4383d5d1-290d-4855-8aa3-95adf0fdf45d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:53.397624 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383d5d1-290d-4855-8aa3-95adf0fdf45d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:53.448298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383d5d1-290d-4855-8aa3-95adf0fdf45d service placement] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:53.467793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1308/2603] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:53 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:55.075978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:55.079152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:55.114098 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b95f6c-f5b0-49b8-8ba6-2cfa67a122c7 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:55.120742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:55.122152 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:55.122432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:55.123108 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] PATH_INFO: `/v3/users/9a05ec0df9334b0ca96bffdd9fdfe99d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:55.124579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a05ec0df9334b0ca96bffdd9fdfe99d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:55.156344 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:55.231870 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a05ec0df9334b0ca96bffdd9fdfe99d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.253211 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a05ec0df9334b0ca96bffdd9fdfe99d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.263506 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a05ec0df9334b0ca96bffdd9fdfe99d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.264222 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a05ec0df9334b0ca96bffdd9fdfe99d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.276309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2f3e1b8d-e445-41be-872b-f601384a6474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a05ec0df9334b0ca96bffdd9fdfe99d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.284869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1296/2604] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:50:55 2021] DELETE /identity/v3/users/9a05ec0df9334b0ca96bffdd9fdfe99d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:50:55.736035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383d5d1-290d-4855-8aa3-95adf0fdf45d service placement] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:55.752524 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383d5d1-290d-4855-8aa3-95adf0fdf45d service placement] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:55.837832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:55.838693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:55.838978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:55.839263 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] PATH_INFO: `/v3/projects/eb6df6b44f0d42339c2fd1095ce3bdf9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:55.840366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6df6b44f0d42339c2fd1095ce3bdf9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:55.871148 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:55.944270 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'request_id': 'req-99b60b4e-34f6-48aa-b8fc-80bb920c40db'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.959140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'request_id': 'req-99b60b4e-34f6-48aa-b8fc-80bb920c40db'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.970846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6df6b44f0d42339c2fd1095ce3bdf9', 'request_id': 'req-99b60b4e-34f6-48aa-b8fc-80bb920c40db'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.989006 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] The token cache is being invalidate because project eb6df6b44f0d42339c2fd1095ce3bdf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:50:55.989542 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.990545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-99b60b4e-34f6-48aa-b8fc-80bb920c40db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:55.992988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1309/2605] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:50:55 2021] DELETE /identity/v3/projects/eb6df6b44f0d42339c2fd1095ce3bdf9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:50:56.002805 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca985f6-3d7c-47ff-9c9e-f2c16a6b95e4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.003069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca985f6-3d7c-47ff-9c9e-f2c16a6b95e4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.003476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca985f6-3d7c-47ff-9c9e-f2c16a6b95e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.111964 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-5ca985f6-3d7c-47ff-9c9e-f2c16a6b95e4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:56.114317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-5ca985f6-3d7c-47ff-9c9e-f2c16a6b95e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:56.196938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1297/2606] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:50:56.206138 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab071-de1a-49e6-8782-783f5d18f11e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.206339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab071-de1a-49e6-8782-783f5d18f11e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.206616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab071-de1a-49e6-8782-783f5d18f11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.231552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b45ab071-de1a-49e6-8782-783f5d18f11e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:56.232985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b45ab071-de1a-49e6-8782-783f5d18f11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:56.242422 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1310/2607] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:50:56.246427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca985f6-3d7c-47ff-9c9e-f2c16a6b95e4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:56.258835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca985f6-3d7c-47ff-9c9e-f2c16a6b95e4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:56.261515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:56.262148 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.262688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.262688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.263385 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:50:56.263681 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:56.289147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:56.305236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1298/2608] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:50:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:50:56.310287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab071-de1a-49e6-8782-783f5d18f11e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:56.321452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab071-de1a-49e6-8782-783f5d18f11e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:56.327026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d7f4-60bb-4ea1-9f7f-5921cfdd0165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:56.327657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d7f4-60bb-4ea1-9f7f-5921cfdd0165 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.327942 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d7f4-60bb-4ea1-9f7f-5921cfdd0165 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.328218 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d7f4-60bb-4ea1-9f7f-5921cfdd0165 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.328894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4d7f4-60bb-4ea1-9f7f-5921cfdd0165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:56.356078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4d7f4-60bb-4ea1-9f7f-5921cfdd0165 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:56.388289 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1311/2609] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:50:56 2021] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:50:56.392533 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:56.394831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:56.395017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d7f4-60bb-4ea1-9f7f-5921cfdd0165 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:56.425524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ed978-d425-4ea7-981b-c8951e3003af admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:56.475850 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d7f4-60bb-4ea1-9f7f-5921cfdd0165 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:56.481221 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d840a07-327e-4504-b5d7-b24a748a4a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:56.486202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d840a07-327e-4504-b5d7-b24a748a4a17 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.486202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d840a07-327e-4504-b5d7-b24a748a4a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.486202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d840a07-327e-4504-b5d7-b24a748a4a17 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.486202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d840a07-327e-4504-b5d7-b24a748a4a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:56.510338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d840a07-327e-4504-b5d7-b24a748a4a17 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:56.518055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:56.518892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.519178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.519452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] PATH_INFO: `/v3/users/0d72966786b641f48edda655d2d0ba45` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.520881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d72966786b641f48edda655d2d0ba45)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:56.533421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1312/2610] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:50:56 2021] POST /identity/v3/users => generated 284 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:50:56.537372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d840a07-327e-4504-b5d7-b24a748a4a17 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:56.546444 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:56.547443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d840a07-327e-4504-b5d7-b24a748a4a17 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:56.552015 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89672c4-0ba2-4e06-9d3d-fd76c4f22b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:56.552634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89672c4-0ba2-4e06-9d3d-fd76c4f22b78 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.552913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89672c4-0ba2-4e06-9d3d-fd76c4f22b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.553194 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89672c4-0ba2-4e06-9d3d-fd76c4f22b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.554025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89672c4-0ba2-4e06-9d3d-fd76c4f22b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:56.581579 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89672c4-0ba2-4e06-9d3d-fd76c4f22b78 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:56.596815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1313/2611] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:50:56 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:50:56.599528 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89672c4-0ba2-4e06-9d3d-fd76c4f22b78 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:56.605068 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d72966786b641f48edda655d2d0ba45'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:56.609798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89672c4-0ba2-4e06-9d3d-fd76c4f22b78 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:56.617884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d72966786b641f48edda655d2d0ba45'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:56.618380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ff809-9d71-4996-a016-6a232e93eb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:56.619378 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ff809-9d71-4996-a016-6a232e93eb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.619852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ff809-9d71-4996-a016-6a232e93eb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.620139 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ff809-9d71-4996-a016-6a232e93eb8f admin admin] PATH_INFO: `/v3/projects/4cf6bb6b770c4decb3611b5255ec2a94/users/e853cc09f22b4f0a9aca967545cbc6bd/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.625891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d72966786b641f48edda655d2d0ba45'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:56.627144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d72966786b641f48edda655d2d0ba45'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:56.635590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b9c3dac0-e689-471d-a550-c98fbaae7962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d72966786b641f48edda655d2d0ba45'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:56.641675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ff809-9d71-4996-a016-6a232e93eb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf6bb6b770c4decb3611b5255ec2a94, user_id=e853cc09f22b4f0a9aca967545cbc6bd, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:56.642419 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1299/2612] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:50:56 2021] DELETE /identity/v3/users/0d72966786b641f48edda655d2d0ba45 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:50:56.669080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ff809-9d71-4996-a016-6a232e93eb8f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:56.685290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1314/2613] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:50:56 2021] PUT /identity/v3/projects/4cf6bb6b770c4decb3611b5255ec2a94/users/e853cc09f22b4f0a9aca967545cbc6bd/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:50:56.696729 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a18f1-95ef-4de2-b46d-ab65c86e9f71 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.697169 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a18f1-95ef-4de2-b46d-ab65c86e9f71 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.697459 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a18f1-95ef-4de2-b46d-ab65c86e9f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.737719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-8a1a18f1-95ef-4de2-b46d-ab65c86e9f71 None None] MFA Rules not processed for user `e853cc09f22b4f0a9aca967545cbc6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:56.738833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8a1a18f1-95ef-4de2-b46d-ab65c86e9f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:56.820383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1300/2614] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:56 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:50:56.830552 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ff809-9d71-4996-a016-6a232e93eb8f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:56.833366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-389ff809-9d71-4996-a016-6a232e93eb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:56.900381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a18f1-95ef-4de2-b46d-ab65c86e9f71 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:56.901840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8a1a18f1-95ef-4de2-b46d-ab65c86e9f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:56.924896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ff809-9d71-4996-a016-6a232e93eb8f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:56.928721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371444-5e92-4ede-bf94-9cea81d5ba02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:56.929425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371444-5e92-4ede-bf94-9cea81d5ba02 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.929736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371444-5e92-4ede-bf94-9cea81d5ba02 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.930041 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371444-5e92-4ede-bf94-9cea81d5ba02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.939594 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371444-5e92-4ede-bf94-9cea81d5ba02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:56.965608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371444-5e92-4ede-bf94-9cea81d5ba02 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:56.975632 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1315/2615] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:56 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:56.982059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a18f1-95ef-4de2-b46d-ab65c86e9f71 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:56.987046 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:56.987934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:56.988102 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:56.988416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] PATH_INFO: `/v3/projects/198be39f56934fc58b1c76e532336733` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:56.989543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198be39f56934fc58b1c76e532336733)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:57.015568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:57.076742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198be39f56934fc58b1c76e532336733', 'request_id': 'req-2a8caa7c-a70f-4907-8edd-aeb9ec391376'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:57.090563 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198be39f56934fc58b1c76e532336733', 'request_id': 'req-2a8caa7c-a70f-4907-8edd-aeb9ec391376'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:57.100043 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198be39f56934fc58b1c76e532336733', 'request_id': 'req-2a8caa7c-a70f-4907-8edd-aeb9ec391376'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:57.118897 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] The token cache is being invalidate because project 198be39f56934fc58b1c76e532336733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:50:57.119549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:57.120176 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2a8caa7c-a70f-4907-8edd-aeb9ec391376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:57.121781 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1301/2616] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:50:56 2021] DELETE /identity/v3/projects/198be39f56934fc58b1c76e532336733 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:50:57.129354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75b0c8-2a4e-4494-a8b5-c831dbb1f247 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:57.130109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75b0c8-2a4e-4494-a8b5-c831dbb1f247 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:57.130771 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75b0c8-2a4e-4494-a8b5-c831dbb1f247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:57.174359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-4f75b0c8-2a4e-4494-a8b5-c831dbb1f247 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:57.175741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4f75b0c8-2a4e-4494-a8b5-c831dbb1f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:57.275621 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1316/2617] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:50:57.283667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bad9ce-c436-4cc5-be89-22d11bd02298 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:57.283923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bad9ce-c436-4cc5-be89-22d11bd02298 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:57.284217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bad9ce-c436-4cc5-be89-22d11bd02298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:57.309619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-62bad9ce-c436-4cc5-be89-22d11bd02298 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:57.311163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-62bad9ce-c436-4cc5-be89-22d11bd02298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:57.321242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1302/2618] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:50:57.325886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75b0c8-2a4e-4494-a8b5-c831dbb1f247 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:57.337186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75b0c8-2a4e-4494-a8b5-c831dbb1f247 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:57.342135 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155096d9-bbcf-44b2-940e-992c1b6ceadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:57.342754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155096d9-bbcf-44b2-940e-992c1b6ceadf admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:57.343112 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155096d9-bbcf-44b2-940e-992c1b6ceadf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:57.343441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155096d9-bbcf-44b2-940e-992c1b6ceadf admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:57.344217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155096d9-bbcf-44b2-940e-992c1b6ceadf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:50:57.344608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155096d9-bbcf-44b2-940e-992c1b6ceadf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:57.370217 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155096d9-bbcf-44b2-940e-992c1b6ceadf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:57.388803 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1317/2619] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:50:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:50:57.393788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bad9ce-c436-4cc5-be89-22d11bd02298 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:57.404079 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bad9ce-c436-4cc5-be89-22d11bd02298 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:57.411174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241649ff-ac7c-4066-b460-a6b95e655db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:57.412115 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241649ff-ac7c-4066-b460-a6b95e655db7 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:57.412470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241649ff-ac7c-4066-b460-a6b95e655db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:57.412935 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241649ff-ac7c-4066-b460-a6b95e655db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:57.414026 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241649ff-ac7c-4066-b460-a6b95e655db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:57.441811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241649ff-ac7c-4066-b460-a6b95e655db7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:57.478577 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1303/2620] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:50:57 2021] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:50:57.482606 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155096d9-bbcf-44b2-940e-992c1b6ceadf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:57.493961 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155096d9-bbcf-44b2-940e-992c1b6ceadf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:57.569273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b596-8cf1-42b7-86b4-4b44128f0da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:57.569913 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b596-8cf1-42b7-86b4-4b44128f0da0 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:57.570231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b596-8cf1-42b7-86b4-4b44128f0da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:57.570529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b596-8cf1-42b7-86b4-4b44128f0da0 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:57.571143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b596-8cf1-42b7-86b4-4b44128f0da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:57.597798 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b596-8cf1-42b7-86b4-4b44128f0da0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:57.620950 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1318/2621] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:50:57 2021] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:50:57.625533 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241649ff-ac7c-4066-b460-a6b95e655db7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:57.637013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241649ff-ac7c-4066-b460-a6b95e655db7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:57.641614 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd51300-5c55-4cb1-8267-ebe1d246945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:57.642287 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd51300-5c55-4cb1-8267-ebe1d246945e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:57.642570 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd51300-5c55-4cb1-8267-ebe1d246945e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:57.642843 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd51300-5c55-4cb1-8267-ebe1d246945e admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:57.643554 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd51300-5c55-4cb1-8267-ebe1d246945e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:57.672384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd51300-5c55-4cb1-8267-ebe1d246945e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:57.683550 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1304/2622] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:50:57 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:50:57.688191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b596-8cf1-42b7-86b4-4b44128f0da0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:57.699313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b596-8cf1-42b7-86b4-4b44128f0da0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:57.704566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78754-556d-4e48-872a-76ee25a64953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:57.705399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78754-556d-4e48-872a-76ee25a64953 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:57.705690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78754-556d-4e48-872a-76ee25a64953 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:57.705951 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78754-556d-4e48-872a-76ee25a64953 admin admin] PATH_INFO: `/v3/projects/fb070b91996142cfa33d62ced872d333/users/3299bcccb9d04843be7475da5b925ff6/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:57.729366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa78754-556d-4e48-872a-76ee25a64953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb070b91996142cfa33d62ced872d333, user_id=3299bcccb9d04843be7475da5b925ff6, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:57.756005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa78754-556d-4e48-872a-76ee25a64953 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:57.772587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1319/2623] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:50:57 2021] PUT /identity/v3/projects/fb070b91996142cfa33d62ced872d333/users/3299bcccb9d04843be7475da5b925ff6/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:50:57.783242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fad10-7724-49f3-a495-f8949505d4c9 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:57.783455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fad10-7724-49f3-a495-f8949505d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:57.783747 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fad10-7724-49f3-a495-f8949505d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:57.826603 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b80fad10-7724-49f3-a495-f8949505d4c9 None None] MFA Rules not processed for user `3299bcccb9d04843be7475da5b925ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:57.827807 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b80fad10-7724-49f3-a495-f8949505d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:57.904953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1305/2624] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:57 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:50:57.916104 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78754-556d-4e48-872a-76ee25a64953 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:57.917919 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2fa78754-556d-4e48-872a-76ee25a64953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:58.002158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78754-556d-4e48-872a-76ee25a64953 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:58.007978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676b092-1321-428f-a089-5227fe72c6a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:58.008572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676b092-1321-428f-a089-5227fe72c6a3 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:58.008860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676b092-1321-428f-a089-5227fe72c6a3 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:58.009145 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676b092-1321-428f-a089-5227fe72c6a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:58.018023 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676b092-1321-428f-a089-5227fe72c6a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:58.043934 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676b092-1321-428f-a089-5227fe72c6a3 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:58.054708 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1320/2625] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:57 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:58.418952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fad10-7724-49f3-a495-f8949505d4c9 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:58.492602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fad10-7724-49f3-a495-f8949505d4c9 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:58.497085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:58.497938 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:58.498259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:58.498539 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] PATH_INFO: `/v3/users/3299bcccb9d04843be7475da5b925ff6` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:58.499638 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3299bcccb9d04843be7475da5b925ff6)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:58.525408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:58.582571 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3299bcccb9d04843be7475da5b925ff6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:58.595979 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3299bcccb9d04843be7475da5b925ff6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:58.603770 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3299bcccb9d04843be7475da5b925ff6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:58.604589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3299bcccb9d04843be7475da5b925ff6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:58.613285 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3299bcccb9d04843be7475da5b925ff6'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:58.619958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1306/2626] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:50:58 2021] DELETE /identity/v3/users/3299bcccb9d04843be7475da5b925ff6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:50:58.624515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f97ec-466f-4d3a-bd62-a3cdaeacfb96 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:58.624808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f97ec-466f-4d3a-bd62-a3cdaeacfb96 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:58.625203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f97ec-466f-4d3a-bd62-a3cdaeacfb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:58.649411 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-129f97ec-466f-4d3a-bd62-a3cdaeacfb96 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:58.651231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-129f97ec-466f-4d3a-bd62-a3cdaeacfb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:58.728280 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1321/2627] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:50:58.739049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:58.740464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:58.814966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2449801-b5fc-47d2-a6ba-3c69f1cdfba3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:58.819223 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1b51a-ff15-497f-9bce-b306aef2ba38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:58.819936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b51a-ff15-497f-9bce-b306aef2ba38 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:58.820105 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b51a-ff15-497f-9bce-b306aef2ba38 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:58.820381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b51a-ff15-497f-9bce-b306aef2ba38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:58.830658 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1b51a-ff15-497f-9bce-b306aef2ba38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:58.856475 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1b51a-ff15-497f-9bce-b306aef2ba38 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:58.867179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1307/2628] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:50:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:50:59.350387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f97ec-466f-4d3a-bd62-a3cdaeacfb96 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:59.359597 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-129f97ec-466f-4d3a-bd62-a3cdaeacfb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:59.374391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f97ec-466f-4d3a-bd62-a3cdaeacfb96 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:59.379042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:59.380174 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:59.380634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:59.381018 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] PATH_INFO: `/v3/projects/fb070b91996142cfa33d62ced872d333` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:59.382259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb070b91996142cfa33d62ced872d333)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:59.411197 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:59.470863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb070b91996142cfa33d62ced872d333', 'request_id': 'req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:59.482360 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb070b91996142cfa33d62ced872d333', 'request_id': 'req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:59.492266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb070b91996142cfa33d62ced872d333', 'request_id': 'req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:59.506843 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] The token cache is being invalidate because project fb070b91996142cfa33d62ced872d333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:50:59.507191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:59.508019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a4ef88b1-6a6f-46c3-a313-6b0d3f10d96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:50:59.509639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1322/2629] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:50:59 2021] DELETE /identity/v3/projects/fb070b91996142cfa33d62ced872d333 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:50:59.515569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5e08-1597-45cc-8dd6-0435f0e0d763 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:59.516969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5e08-1597-45cc-8dd6-0435f0e0d763 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:59.516969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5e08-1597-45cc-8dd6-0435f0e0d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:59.540032 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-59cf5e08-1597-45cc-8dd6-0435f0e0d763 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:59.541206 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-59cf5e08-1597-45cc-8dd6-0435f0e0d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:59.610859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1308/2630] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:50:59.620304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1213-03d0-4dfc-9fdd-662e455e4a78 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:59.620616 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1213-03d0-4dfc-9fdd-662e455e4a78 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:59.620862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1213-03d0-4dfc-9fdd-662e455e4a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:59.647356 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-971d1213-03d0-4dfc-9fdd-662e455e4a78 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:50:59.648538 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-971d1213-03d0-4dfc-9fdd-662e455e4a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:50:59.656398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1323/2631] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:50:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:50:59.660876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5e08-1597-45cc-8dd6-0435f0e0d763 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:59.670607 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5e08-1597-45cc-8dd6-0435f0e0d763 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:59.675177 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9a2ea-727c-4a68-b4cc-cce59c7d0109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:59.675801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9a2ea-727c-4a68-b4cc-cce59c7d0109 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:59.676101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9a2ea-727c-4a68-b4cc-cce59c7d0109 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:59.676383 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9a2ea-727c-4a68-b4cc-cce59c7d0109 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:59.677089 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9a2ea-727c-4a68-b4cc-cce59c7d0109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:50:59.677386 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9a2ea-727c-4a68-b4cc-cce59c7d0109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:59.703180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9a2ea-727c-4a68-b4cc-cce59c7d0109 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:59.719379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1309/2632] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:50:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:50:59.724173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d1213-03d0-4dfc-9fdd-662e455e4a78 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:59.733389 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d1213-03d0-4dfc-9fdd-662e455e4a78 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:59.738883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54459c75-b6c6-4921-8a28-190bde43675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:59.739461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54459c75-b6c6-4921-8a28-190bde43675e admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:59.739736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54459c75-b6c6-4921-8a28-190bde43675e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:59.740005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54459c75-b6c6-4921-8a28-190bde43675e admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:59.740628 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54459c75-b6c6-4921-8a28-190bde43675e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:59.766569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54459c75-b6c6-4921-8a28-190bde43675e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:59.796889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1324/2633] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:50:59 2021] POST /identity/v3/projects => generated 405 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:50:59.801673 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9a2ea-727c-4a68-b4cc-cce59c7d0109 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:59.813524 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9a2ea-727c-4a68-b4cc-cce59c7d0109 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:59.881572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d338fa0-d400-4d23-8fdf-c78dd876de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:59.882170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338fa0-d400-4d23-8fdf-c78dd876de39 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:59.882514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338fa0-d400-4d23-8fdf-c78dd876de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:59.882903 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338fa0-d400-4d23-8fdf-c78dd876de39 admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:59.883698 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d338fa0-d400-4d23-8fdf-c78dd876de39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:59.909532 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d338fa0-d400-4d23-8fdf-c78dd876de39 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:59.930891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1310/2634] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:50:59 2021] POST /identity/v3/users => generated 303 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:50:59.935204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54459c75-b6c6-4921-8a28-190bde43675e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:50:59.945782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54459c75-b6c6-4921-8a28-190bde43675e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:50:59.950838 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebd148-9002-4097-bc8e-703ff890a331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:50:59.951465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebd148-9002-4097-bc8e-703ff890a331 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:50:59.951760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebd148-9002-4097-bc8e-703ff890a331 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:50:59.952038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebd148-9002-4097-bc8e-703ff890a331 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:50:59.952741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebd148-9002-4097-bc8e-703ff890a331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:50:59.979723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebd148-9002-4097-bc8e-703ff890a331 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:50:59.990779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1325/2635] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:50:59 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:50:59.995270 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d338fa0-d400-4d23-8fdf-c78dd876de39 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:00.006496 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d338fa0-d400-4d23-8fdf-c78dd876de39 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:00.011557 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9bb1b-6e9c-4b03-b323-5a469c5e4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:00.012402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9bb1b-6e9c-4b03-b323-5a469c5e4efa admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:00.012687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9bb1b-6e9c-4b03-b323-5a469c5e4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:00.012965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9bb1b-6e9c-4b03-b323-5a469c5e4efa admin admin] PATH_INFO: `/v3/projects/42d29325ff154e31b464258a028bbf17/users/c5bf4b23382a4748beb83deb35228982/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:00.036117 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9bb1b-6e9c-4b03-b323-5a469c5e4efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d29325ff154e31b464258a028bbf17, user_id=c5bf4b23382a4748beb83deb35228982, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:00.063166 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9bb1b-6e9c-4b03-b323-5a469c5e4efa admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:00.079527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1311/2636] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:50:59 2021] PUT /identity/v3/projects/42d29325ff154e31b464258a028bbf17/users/c5bf4b23382a4748beb83deb35228982/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:00.085005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb1581-fd81-4778-beff-5ef166a0a475 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:00.085298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb1581-fd81-4778-beff-5ef166a0a475 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:00.085580 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb1581-fd81-4778-beff-5ef166a0a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:00.109075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b7cb1581-fd81-4778-beff-5ef166a0a475 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:00.110559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b7cb1581-fd81-4778-beff-5ef166a0a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:00.189236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1326/2637] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:00.199818 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9bb1b-6e9c-4b03-b323-5a469c5e4efa admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:00.201561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2fc9bb1b-6e9c-4b03-b323-5a469c5e4efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:00.267975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9bb1b-6e9c-4b03-b323-5a469c5e4efa admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:00.271633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6819-c79c-4447-b43d-644b5754af3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:00.272214 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6819-c79c-4447-b43d-644b5754af3d service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:00.272485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6819-c79c-4447-b43d-644b5754af3d service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:00.272765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6819-c79c-4447-b43d-644b5754af3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:00.281801 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6819-c79c-4447-b43d-644b5754af3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:00.306984 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6819-c79c-4447-b43d-644b5754af3d service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:00.316961 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1312/2638] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:01.320990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158576e-5f0b-48d7-b8fb-dff2ca1d3cb9 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:01.321670 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158576e-5f0b-48d7-b8fb-dff2ca1d3cb9 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:01.321823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158576e-5f0b-48d7-b8fb-dff2ca1d3cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:01.362941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d158576e-5f0b-48d7-b8fb-dff2ca1d3cb9 None None] MFA Rules not processed for user `c5bf4b23382a4748beb83deb35228982`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:01.364657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d158576e-5f0b-48d7-b8fb-dff2ca1d3cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:01.445496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1327/2639] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:01 2021] POST /identity/v3/auth/tokens => generated 3712 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:01.450437 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6819-c79c-4447-b43d-644b5754af3d service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:01.462180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6819-c79c-4447-b43d-644b5754af3d service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:01.467527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1dde9-ef4b-4b76-99da-9b378ec6a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:01.468323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1dde9-ef4b-4b76-99da-9b378ec6a371 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:01.468655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1dde9-ef4b-4b76-99da-9b378ec6a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:01.469238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1dde9-ef4b-4b76-99da-9b378ec6a371 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:01.469711 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1dde9-ef4b-4b76-99da-9b378ec6a371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:01.496906 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1dde9-ef4b-4b76-99da-9b378ec6a371 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:01.529378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1313/2640] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:01 2021] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:01.534655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158576e-5f0b-48d7-b8fb-dff2ca1d3cb9 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:01.546642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158576e-5f0b-48d7-b8fb-dff2ca1d3cb9 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:01.618689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c2de8-4727-4029-8d6d-dcf81d5fafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:01.619500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c2de8-4727-4029-8d6d-dcf81d5fafe5 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:01.619787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c2de8-4727-4029-8d6d-dcf81d5fafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:01.620071 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c2de8-4727-4029-8d6d-dcf81d5fafe5 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:01.620737 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c2de8-4727-4029-8d6d-dcf81d5fafe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:01.646662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c2de8-4727-4029-8d6d-dcf81d5fafe5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:01.669931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1328/2641] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:01 2021] POST /identity/v3/users => generated 308 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:01.674506 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1dde9-ef4b-4b76-99da-9b378ec6a371 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:01.685349 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1dde9-ef4b-4b76-99da-9b378ec6a371 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:01.691395 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20e7b-4797-4d55-8af1-cad34b6482ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:01.692151 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20e7b-4797-4d55-8af1-cad34b6482ee admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:01.692457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20e7b-4797-4d55-8af1-cad34b6482ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:01.692751 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20e7b-4797-4d55-8af1-cad34b6482ee admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:01.693460 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c20e7b-4797-4d55-8af1-cad34b6482ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:01.722667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c20e7b-4797-4d55-8af1-cad34b6482ee admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:01.737947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1314/2642] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:01 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:01.742435 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c2de8-4727-4029-8d6d-dcf81d5fafe5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:01.755786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c2de8-4727-4029-8d6d-dcf81d5fafe5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:01.761214 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002b19-bab6-4576-818d-02eea6a96bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:01.762706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002b19-bab6-4576-818d-02eea6a96bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:01.763003 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002b19-bab6-4576-818d-02eea6a96bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:01.763287 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002b19-bab6-4576-818d-02eea6a96bc5 admin admin] PATH_INFO: `/v3/projects/f8fb5dcc3f2b4b90982f9d8954e5075a/users/b746f4627b944661906ad0ea2ebfb254/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:01.786323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002b19-bab6-4576-818d-02eea6a96bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fb5dcc3f2b4b90982f9d8954e5075a, user_id=b746f4627b944661906ad0ea2ebfb254, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:01.813448 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002b19-bab6-4576-818d-02eea6a96bc5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:01.829921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1329/2643] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:01 2021] PUT /identity/v3/projects/f8fb5dcc3f2b4b90982f9d8954e5075a/users/b746f4627b944661906ad0ea2ebfb254/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:01.834710 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20e7b-4797-4d55-8af1-cad34b6482ee admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:01.844923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20e7b-4797-4d55-8af1-cad34b6482ee admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:01.912408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9ca3-98cc-4067-8d60-4b4b654f00e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:01.913034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9ca3-98cc-4067-8d60-4b4b654f00e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:01.913320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9ca3-98cc-4067-8d60-4b4b654f00e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:01.913594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9ca3-98cc-4067-8d60-4b4b654f00e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:01.914347 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a9ca3-98cc-4067-8d60-4b4b654f00e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:01.939806 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a9ca3-98cc-4067-8d60-4b4b654f00e3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:01.950842 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1315/2644] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:01 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:01.955375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002b19-bab6-4576-818d-02eea6a96bc5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:01.966426 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002b19-bab6-4576-818d-02eea6a96bc5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:01.971912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c394-eca3-422a-bfed-8e65b7cfbfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:01.972819 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c394-eca3-422a-bfed-8e65b7cfbfaf admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:01.973075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c394-eca3-422a-bfed-8e65b7cfbfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:01.973372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c394-eca3-422a-bfed-8e65b7cfbfaf admin admin] PATH_INFO: `/v3/projects/f8fb5dcc3f2b4b90982f9d8954e5075a/users/b746f4627b944661906ad0ea2ebfb254/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:01.975310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87c394-eca3-422a-bfed-8e65b7cfbfaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fb5dcc3f2b4b90982f9d8954e5075a, user_id=b746f4627b944661906ad0ea2ebfb254, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:02.002337 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87c394-eca3-422a-bfed-8e65b7cfbfaf admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:02.013488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1330/2645] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:01 2021] PUT /identity/v3/projects/f8fb5dcc3f2b4b90982f9d8954e5075a/users/b746f4627b944661906ad0ea2ebfb254/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:02.018617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9ca3-98cc-4067-8d60-4b4b654f00e3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:02.028996 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9ca3-98cc-4067-8d60-4b4b654f00e3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:02.098172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a78aa-464d-4276-8455-fb7bba0f5d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:02.098833 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a78aa-464d-4276-8455-fb7bba0f5d27 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:02.099069 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a78aa-464d-4276-8455-fb7bba0f5d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:02.099351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a78aa-464d-4276-8455-fb7bba0f5d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:02.100047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a78aa-464d-4276-8455-fb7bba0f5d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:02.128231 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a78aa-464d-4276-8455-fb7bba0f5d27 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:02.142786 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1316/2646] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:02 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:02.144057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c394-eca3-422a-bfed-8e65b7cfbfaf admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:02.154295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c394-eca3-422a-bfed-8e65b7cfbfaf admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:02.160611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9d335-9776-48d3-be8c-410035d43755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:02.161493 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9d335-9776-48d3-be8c-410035d43755 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:02.162296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9d335-9776-48d3-be8c-410035d43755 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:02.162296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9d335-9776-48d3-be8c-410035d43755 admin admin] PATH_INFO: `/v3/projects/f8fb5dcc3f2b4b90982f9d8954e5075a/users/b746f4627b944661906ad0ea2ebfb254/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:02.165109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9d335-9776-48d3-be8c-410035d43755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fb5dcc3f2b4b90982f9d8954e5075a, user_id=b746f4627b944661906ad0ea2ebfb254, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:02.192175 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9d335-9776-48d3-be8c-410035d43755 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:02.212684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1331/2647] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:02 2021] PUT /identity/v3/projects/f8fb5dcc3f2b4b90982f9d8954e5075a/users/b746f4627b944661906ad0ea2ebfb254/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:03.140312 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8ea00-1cbb-42a7-bced-3745b824e04e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:03.140881 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8ea00-1cbb-42a7-bced-3745b824e04e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:03.141315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8ea00-1cbb-42a7-bced-3745b824e04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:03.220497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d4f8ea00-1cbb-42a7-bced-3745b824e04e None None] MFA Rules not processed for user `b746f4627b944661906ad0ea2ebfb254`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:03.222569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d4f8ea00-1cbb-42a7-bced-3745b824e04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:03.323810 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1317/2648] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:03 2021] POST /identity/v3/auth/tokens => generated 3777 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:05.126440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9d335-9776-48d3-be8c-410035d43755 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:05.198626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9d335-9776-48d3-be8c-410035d43755 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:05.203412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:05.204223 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:05.204498 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:05.204770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] PATH_INFO: `/v3/users/c5bf4b23382a4748beb83deb35228982` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:05.205904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5bf4b23382a4748beb83deb35228982)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:05.240937 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:05.295740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5bf4b23382a4748beb83deb35228982'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.303307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5bf4b23382a4748beb83deb35228982'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.303947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5bf4b23382a4748beb83deb35228982'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.311475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5bf4b23382a4748beb83deb35228982'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.324447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5bf4b23382a4748beb83deb35228982'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.330559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1332/2649] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:05 2021] DELETE /identity/v3/users/c5bf4b23382a4748beb83deb35228982 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:05.679713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8ea00-1cbb-42a7-bced-3745b824e04e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:05.691904 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8ea00-1cbb-42a7-bced-3745b824e04e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:05.761093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:05.761912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:05.762226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:05.762509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] PATH_INFO: `/v3/projects/42d29325ff154e31b464258a028bbf17` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:05.763664 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d29325ff154e31b464258a028bbf17)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:05.789402 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:05.844201 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d29325ff154e31b464258a028bbf17', 'request_id': 'req-7eec5b4c-4d07-46fd-965f-b2338d1a8587'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.856619 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d29325ff154e31b464258a028bbf17', 'request_id': 'req-7eec5b4c-4d07-46fd-965f-b2338d1a8587'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.866091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d29325ff154e31b464258a028bbf17', 'request_id': 'req-7eec5b4c-4d07-46fd-965f-b2338d1a8587'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.879292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] The token cache is being invalidate because project 42d29325ff154e31b464258a028bbf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:05.879292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.879292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:05.880376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1318/2650] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:05 2021] DELETE /identity/v3/projects/42d29325ff154e31b464258a028bbf17 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:05.884710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:05.886102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:05.899146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c64de1-07a0-4697-a5f4-c5dc0fe07a0e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:05.970227 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:05.971048 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:05.971383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:05.971617 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] PATH_INFO: `/v3/users/b746f4627b944661906ad0ea2ebfb254` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:05.973094 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b746f4627b944661906ad0ea2ebfb254)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:06.006641 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:06.072407 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b746f4627b944661906ad0ea2ebfb254'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.081822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b746f4627b944661906ad0ea2ebfb254'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.083018 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b746f4627b944661906ad0ea2ebfb254'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.096744 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b746f4627b944661906ad0ea2ebfb254'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.107440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-08e2d413-92b0-4e10-97c1-c9905bf46af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b746f4627b944661906ad0ea2ebfb254'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.114796 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1333/2651] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:05 2021] DELETE /identity/v3/users/b746f4627b944661906ad0ea2ebfb254 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:06.351309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:06.353025 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:06.368685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec5b4c-4d07-46fd-965f-b2338d1a8587 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:06.437586 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:06.439009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:06.439494 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:06.439991 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] PATH_INFO: `/v3/projects/f8fb5dcc3f2b4b90982f9d8954e5075a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:06.442017 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8fb5dcc3f2b4b90982f9d8954e5075a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:06.496501 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:06.570091 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8fb5dcc3f2b4b90982f9d8954e5075a', 'request_id': 'req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.581859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8fb5dcc3f2b4b90982f9d8954e5075a', 'request_id': 'req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.591290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8fb5dcc3f2b4b90982f9d8954e5075a', 'request_id': 'req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.601911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] The token cache is being invalidate because project f8fb5dcc3f2b4b90982f9d8954e5075a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:06.602224 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.602859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-a1d2e1c7-bfc7-4f4b-94c2-661149fc14ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:06.604339 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1319/2652] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:06 2021] DELETE /identity/v3/projects/f8fb5dcc3f2b4b90982f9d8954e5075a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:06.610372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fd2b-1e55-4c6b-880a-70bc9fff7e90 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:06.610894 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fd2b-1e55-4c6b-880a-70bc9fff7e90 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:06.611100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439fd2b-1e55-4c6b-880a-70bc9fff7e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:06.635585 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-b439fd2b-1e55-4c6b-880a-70bc9fff7e90 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:06.636734 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b439fd2b-1e55-4c6b-880a-70bc9fff7e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:06.706468 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1334/2653] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:06.716163 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a7afd-3b9e-4dd8-8232-221903be12e9 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:06.716858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a7afd-3b9e-4dd8-8232-221903be12e9 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:06.716858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a7afd-3b9e-4dd8-8232-221903be12e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:06.741452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1a0a7afd-3b9e-4dd8-8232-221903be12e9 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:06.742718 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1a0a7afd-3b9e-4dd8-8232-221903be12e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:06.750651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1320/2654] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:06.755234 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439fd2b-1e55-4c6b-880a-70bc9fff7e90 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:06.765305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439fd2b-1e55-4c6b-880a-70bc9fff7e90 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:06.769754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f060b1-93fb-424e-8b5a-1971ceaa37ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:06.770405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f060b1-93fb-424e-8b5a-1971ceaa37ed admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:06.770679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f060b1-93fb-424e-8b5a-1971ceaa37ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:06.770968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f060b1-93fb-424e-8b5a-1971ceaa37ed admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:06.771649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f060b1-93fb-424e-8b5a-1971ceaa37ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:51:06.771975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f060b1-93fb-424e-8b5a-1971ceaa37ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:06.798232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f060b1-93fb-424e-8b5a-1971ceaa37ed admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:06.813147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1335/2655] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:06.817912 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a7afd-3b9e-4dd8-8232-221903be12e9 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:06.827872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a7afd-3b9e-4dd8-8232-221903be12e9 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:06.832732 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac045371-71b8-4776-be4c-8ca0f52c5aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:06.833323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac045371-71b8-4776-be4c-8ca0f52c5aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:06.833640 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac045371-71b8-4776-be4c-8ca0f52c5aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:06.833916 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac045371-71b8-4776-be4c-8ca0f52c5aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:06.834587 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac045371-71b8-4776-be4c-8ca0f52c5aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:06.860448 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac045371-71b8-4776-be4c-8ca0f52c5aa7 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:06.896969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1321/2656] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:06 2021] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:06.901414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f060b1-93fb-424e-8b5a-1971ceaa37ed admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:06.912004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f060b1-93fb-424e-8b5a-1971ceaa37ed admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:06.979770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518b66b-9642-418f-84f8-f44c0eed35d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:06.980386 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518b66b-9642-418f-84f8-f44c0eed35d3 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:06.980682 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518b66b-9642-418f-84f8-f44c0eed35d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:06.981021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518b66b-9642-418f-84f8-f44c0eed35d3 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:06.981679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518b66b-9642-418f-84f8-f44c0eed35d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:07.007499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518b66b-9642-418f-84f8-f44c0eed35d3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:07.029884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1336/2657] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:06 2021] POST /identity/v3/users => generated 282 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:07.034527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac045371-71b8-4776-be4c-8ca0f52c5aa7 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:07.045714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac045371-71b8-4776-be4c-8ca0f52c5aa7 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:07.051259 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0795538-3da7-44ac-9528-68be59ee7330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:07.051880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0795538-3da7-44ac-9528-68be59ee7330 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.052297 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0795538-3da7-44ac-9528-68be59ee7330 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.052568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0795538-3da7-44ac-9528-68be59ee7330 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.053136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0795538-3da7-44ac-9528-68be59ee7330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:07.079083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0795538-3da7-44ac-9528-68be59ee7330 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:07.090648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1322/2658] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:07 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:07.095392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518b66b-9642-418f-84f8-f44c0eed35d3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:07.106615 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518b66b-9642-418f-84f8-f44c0eed35d3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:07.113311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701724be-cbd8-4a8a-b7bc-c5ffaed24617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:07.114501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701724be-cbd8-4a8a-b7bc-c5ffaed24617 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.114797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701724be-cbd8-4a8a-b7bc-c5ffaed24617 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.115082 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701724be-cbd8-4a8a-b7bc-c5ffaed24617 admin admin] PATH_INFO: `/v3/projects/5ba9af4d4d6b4e2e8db11f46d4913f89/users/13e41f62ce584a45bdc1bc4d992b9f8f/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.142559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701724be-cbd8-4a8a-b7bc-c5ffaed24617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba9af4d4d6b4e2e8db11f46d4913f89, user_id=13e41f62ce584a45bdc1bc4d992b9f8f, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:07.157502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0795538-3da7-44ac-9528-68be59ee7330 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:07.159320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-f0795538-3da7-44ac-9528-68be59ee7330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:07.170960 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701724be-cbd8-4a8a-b7bc-c5ffaed24617 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:07.172059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0795538-3da7-44ac-9528-68be59ee7330 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:07.177153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:07.178142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.178411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.179379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] PATH_INFO: `/v3/users/e853cc09f22b4f0a9aca967545cbc6bd` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.180049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e853cc09f22b4f0a9aca967545cbc6bd)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:07.189301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1337/2659] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:07 2021] PUT /identity/v3/projects/5ba9af4d4d6b4e2e8db11f46d4913f89/users/13e41f62ce584a45bdc1bc4d992b9f8f/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:07.200027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd388038-8c8b-412b-b33d-9a55df7d1841 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.200320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd388038-8c8b-412b-b33d-9a55df7d1841 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.200653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd388038-8c8b-412b-b33d-9a55df7d1841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.206455 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:07.245092 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-bd388038-8c8b-412b-b33d-9a55df7d1841 None None] MFA Rules not processed for user `13e41f62ce584a45bdc1bc4d992b9f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:07.247045 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-bd388038-8c8b-412b-b33d-9a55df7d1841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:07.269837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e853cc09f22b4f0a9aca967545cbc6bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:07.290840 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e853cc09f22b4f0a9aca967545cbc6bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:07.305118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e853cc09f22b4f0a9aca967545cbc6bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:07.306340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e853cc09f22b4f0a9aca967545cbc6bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:07.317644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e971bc5a-dd20-4897-9bb6-ac051f12ee91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e853cc09f22b4f0a9aca967545cbc6bd'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:07.327983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1323/2660] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:07 2021] DELETE /identity/v3/users/e853cc09f22b4f0a9aca967545cbc6bd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:07.332793 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1338/2661] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:07 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:07.334646 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754032-c5a6-41c0-a723-dff5ad4f907f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.334942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754032-c5a6-41c0-a723-dff5ad4f907f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.335238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754032-c5a6-41c0-a723-dff5ad4f907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.339471 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd388038-8c8b-412b-b33d-9a55df7d1841 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:07.341826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-bd388038-8c8b-412b-b33d-9a55df7d1841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:07.359311 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-02754032-c5a6-41c0-a723-dff5ad4f907f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:07.360687 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-02754032-c5a6-41c0-a723-dff5ad4f907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:07.428251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd388038-8c8b-412b-b33d-9a55df7d1841 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:07.444366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1324/2662] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:07.457492 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02754032-c5a6-41c0-a723-dff5ad4f907f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:07.458899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-02754032-c5a6-41c0-a723-dff5ad4f907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:07.522317 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179f073-1d71-4246-8371-ea3a83d7a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:07.522830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179f073-1d71-4246-8371-ea3a83d7a5db admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.523115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179f073-1d71-4246-8371-ea3a83d7a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.523405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179f073-1d71-4246-8371-ea3a83d7a5db admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.524063 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179f073-1d71-4246-8371-ea3a83d7a5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:07.531364 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02754032-c5a6-41c0-a723-dff5ad4f907f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:07.535362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40d0e0-e44e-4a02-809f-95cc7c515ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:07.535966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40d0e0-e44e-4a02-809f-95cc7c515ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.536273 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40d0e0-e44e-4a02-809f-95cc7c515ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.536518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40d0e0-e44e-4a02-809f-95cc7c515ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.546256 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40d0e0-e44e-4a02-809f-95cc7c515ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:07.550192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179f073-1d71-4246-8371-ea3a83d7a5db admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:07.572376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40d0e0-e44e-4a02-809f-95cc7c515ef1 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:07.582837 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1339/2663] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:07 2021] POST /identity/v3/projects => generated 363 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:07.583408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1325/2664] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:51:07.587204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179f073-1d71-4246-8371-ea3a83d7a5db admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:07.662535 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179f073-1d71-4246-8371-ea3a83d7a5db admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:07.667318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2586c3-8182-4a33-ae2a-4b469115b991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:07.667935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2586c3-8182-4a33-ae2a-4b469115b991 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.668214 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2586c3-8182-4a33-ae2a-4b469115b991 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.668489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2586c3-8182-4a33-ae2a-4b469115b991 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.669240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2586c3-8182-4a33-ae2a-4b469115b991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:07.696231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2586c3-8182-4a33-ae2a-4b469115b991 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:07.722893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1340/2665] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:07 2021] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:07.728367 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40d0e0-e44e-4a02-809f-95cc7c515ef1 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:07.739966 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40d0e0-e44e-4a02-809f-95cc7c515ef1 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:07.746418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5669c27-d455-4f7c-aa21-360c5be3d748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:07.747602 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5669c27-d455-4f7c-aa21-360c5be3d748 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.748279 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5669c27-d455-4f7c-aa21-360c5be3d748 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.748535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5669c27-d455-4f7c-aa21-360c5be3d748 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.749516 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5669c27-d455-4f7c-aa21-360c5be3d748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:07.797020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5669c27-d455-4f7c-aa21-360c5be3d748 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:07.813608 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1326/2666] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:07 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:07.818064 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2586c3-8182-4a33-ae2a-4b469115b991 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:07.828943 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2586c3-8182-4a33-ae2a-4b469115b991 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:07.834591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e63e-1bd2-413f-9489-6a02b5d6a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:07.835611 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e63e-1bd2-413f-9489-6a02b5d6a98b admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:07.835970 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e63e-1bd2-413f-9489-6a02b5d6a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:07.836349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e63e-1bd2-413f-9489-6a02b5d6a98b admin admin] PATH_INFO: `/v3/projects/815af112391246679330fbf5bf0351f8/users/62abb197036b487d96488c93212bc2ee/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:07.861941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949e63e-1bd2-413f-9489-6a02b5d6a98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=815af112391246679330fbf5bf0351f8, user_id=62abb197036b487d96488c93212bc2ee, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:07.888354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949e63e-1bd2-413f-9489-6a02b5d6a98b admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:07.904382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1341/2667] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:07 2021] PUT /identity/v3/projects/815af112391246679330fbf5bf0351f8/users/62abb197036b487d96488c93212bc2ee/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:07.908828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5669c27-d455-4f7c-aa21-360c5be3d748 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:07.919856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5669c27-d455-4f7c-aa21-360c5be3d748 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.001798 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfce2de-edef-415b-b8ab-369f20d22979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.002481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfce2de-edef-415b-b8ab-369f20d22979 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.002742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfce2de-edef-415b-b8ab-369f20d22979 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.003049 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfce2de-edef-415b-b8ab-369f20d22979 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.003743 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfce2de-edef-415b-b8ab-369f20d22979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.029555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfce2de-edef-415b-b8ab-369f20d22979 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.030216 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e63e-1bd2-413f-9489-6a02b5d6a98b admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.034658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4949e63e-1bd2-413f-9489-6a02b5d6a98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:08.041059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1327/2668] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:07 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:08.045438 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfce2de-edef-415b-b8ab-369f20d22979 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.054783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e63e-1bd2-413f-9489-6a02b5d6a98b admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.055717 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfce2de-edef-415b-b8ab-369f20d22979 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.059469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.060521 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.060710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.060855 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43a814-937f-4a35-93cf-b1a9dd0023be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.060995 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] PATH_INFO: `/v3/projects/4cf6bb6b770c4decb3611b5255ec2a94` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.061597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43a814-937f-4a35-93cf-b1a9dd0023be admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.061848 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43a814-937f-4a35-93cf-b1a9dd0023be admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.062129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf6bb6b770c4decb3611b5255ec2a94)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.062246 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43a814-937f-4a35-93cf-b1a9dd0023be admin admin] PATH_INFO: `/v3/projects/815af112391246679330fbf5bf0351f8/users/62abb197036b487d96488c93212bc2ee/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.064113 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43a814-937f-4a35-93cf-b1a9dd0023be admin admin] RBAC: Authorizing `identity:create_grant(project_id=815af112391246679330fbf5bf0351f8, user_id=62abb197036b487d96488c93212bc2ee, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.088738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.094366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43a814-937f-4a35-93cf-b1a9dd0023be admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.107078 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1328/2669] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:08 2021] PUT /identity/v3/projects/815af112391246679330fbf5bf0351f8/users/62abb197036b487d96488c93212bc2ee/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:08.111631 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43a814-937f-4a35-93cf-b1a9dd0023be admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.144522 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf6bb6b770c4decb3611b5255ec2a94', 'request_id': 'req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:08.157266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf6bb6b770c4decb3611b5255ec2a94', 'request_id': 'req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:08.167000 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf6bb6b770c4decb3611b5255ec2a94', 'request_id': 'req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:08.178405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] The token cache is being invalidate because project 4cf6bb6b770c4decb3611b5255ec2a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:08.178678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:08.179298 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ffc1d821-5a30-4e4c-b3a7-e7394f0af866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:08.180774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1342/2670] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:08 2021] DELETE /identity/v3/projects/4cf6bb6b770c4decb3611b5255ec2a94 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:08.187930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c59ca-6c62-4523-b014-ccc8b3fc58da None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.188328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c59ca-6c62-4523-b014-ccc8b3fc58da None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.188783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c59ca-6c62-4523-b014-ccc8b3fc58da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.191814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43a814-937f-4a35-93cf-b1a9dd0023be admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.214839 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-396c59ca-6c62-4523-b014-ccc8b3fc58da None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:08.217372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-396c59ca-6c62-4523-b014-ccc8b3fc58da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:08.261147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb4eab-e31a-401e-91c8-4465947943fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.261796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb4eab-e31a-401e-91c8-4465947943fb admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.262111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb4eab-e31a-401e-91c8-4465947943fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.262391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb4eab-e31a-401e-91c8-4465947943fb admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.263143 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb4eab-e31a-401e-91c8-4465947943fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.288876 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb4eab-e31a-401e-91c8-4465947943fb admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.290733 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1343/2671] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:08.300057 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e840b-f3a6-4d1b-ac1f-bbd60889a203 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.300267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e840b-f3a6-4d1b-ac1f-bbd60889a203 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.300399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e840b-f3a6-4d1b-ac1f-bbd60889a203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.300766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1329/2672] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:08 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:08.305109 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb4eab-e31a-401e-91c8-4465947943fb admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.306781 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-58cb4eab-e31a-401e-91c8-4465947943fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:08.318572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb4eab-e31a-401e-91c8-4465947943fb admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.323669 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04efbe-cb84-4c7e-97f1-956e2bea6ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.324282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-468e840b-f3a6-4d1b-ac1f-bbd60889a203 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:08.324592 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04efbe-cb84-4c7e-97f1-956e2bea6ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.324939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04efbe-cb84-4c7e-97f1-956e2bea6ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.325600 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-468e840b-f3a6-4d1b-ac1f-bbd60889a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:08.325779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04efbe-cb84-4c7e-97f1-956e2bea6ba5 admin admin] PATH_INFO: `/v3/projects/815af112391246679330fbf5bf0351f8/users/62abb197036b487d96488c93212bc2ee/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.327791 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04efbe-cb84-4c7e-97f1-956e2bea6ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815af112391246679330fbf5bf0351f8, user_id=62abb197036b487d96488c93212bc2ee, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.333500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1344/2673] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:08.337849 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e840b-f3a6-4d1b-ac1f-bbd60889a203 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.347731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e840b-f3a6-4d1b-ac1f-bbd60889a203 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.354772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04efbe-cb84-4c7e-97f1-956e2bea6ba5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.359972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14999b6-f2b2-4737-abe2-baa6895c5e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.360566 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14999b6-f2b2-4737-abe2-baa6895c5e28 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.360852 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14999b6-f2b2-4737-abe2-baa6895c5e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.361362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14999b6-f2b2-4737-abe2-baa6895c5e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.362096 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14999b6-f2b2-4737-abe2-baa6895c5e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:51:08.362443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14999b6-f2b2-4737-abe2-baa6895c5e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.370615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1330/2674] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:08 2021] PUT /identity/v3/projects/815af112391246679330fbf5bf0351f8/users/62abb197036b487d96488c93212bc2ee/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:08.382604 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a992b-41c7-4418-a634-a53fb4bdc468 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.382921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a992b-41c7-4418-a634-a53fb4bdc468 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.383255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a992b-41c7-4418-a634-a53fb4bdc468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.388740 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14999b6-f2b2-4737-abe2-baa6895c5e28 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.403999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1345/2675] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:08.408448 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14999b6-f2b2-4737-abe2-baa6895c5e28 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.418190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14999b6-f2b2-4737-abe2-baa6895c5e28 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.452342 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-fd0a992b-41c7-4418-a634-a53fb4bdc468 None None] MFA Rules not processed for user `62abb197036b487d96488c93212bc2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:08.453499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-fd0a992b-41c7-4418-a634-a53fb4bdc468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:08.512676 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839990-09a1-4faf-88e1-7f46fcbe8386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.513662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839990-09a1-4faf-88e1-7f46fcbe8386 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.514196 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839990-09a1-4faf-88e1-7f46fcbe8386 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.514673 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839990-09a1-4faf-88e1-7f46fcbe8386 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.515887 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a839990-09a1-4faf-88e1-7f46fcbe8386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.534716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1331/2676] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:08 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:08.545611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a992b-41c7-4418-a634-a53fb4bdc468 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.547220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-fd0a992b-41c7-4418-a634-a53fb4bdc468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:08.570710 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a839990-09a1-4faf-88e1-7f46fcbe8386 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.612921 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1346/2677] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:08 2021] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:08.617329 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839990-09a1-4faf-88e1-7f46fcbe8386 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.679921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a992b-41c7-4418-a634-a53fb4bdc468 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.691413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839990-09a1-4faf-88e1-7f46fcbe8386 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.696786 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab71ec-14c5-4945-861f-81f951afaf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.697385 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab71ec-14c5-4945-861f-81f951afaf91 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.697703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab71ec-14c5-4945-861f-81f951afaf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.697978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab71ec-14c5-4945-861f-81f951afaf91 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.698646 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab71ec-14c5-4945-861f-81f951afaf91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.725150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab71ec-14c5-4945-861f-81f951afaf91 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.746275 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcb2e8-0b40-4825-b0ac-1be25f497e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.746974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1347/2678] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:08 2021] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:08.750698 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcb2e8-0b40-4825-b0ac-1be25f497e05 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.751139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcb2e8-0b40-4825-b0ac-1be25f497e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.751304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab71ec-14c5-4945-861f-81f951afaf91 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.751409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcb2e8-0b40-4825-b0ac-1be25f497e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.761367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab71ec-14c5-4945-861f-81f951afaf91 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.766575 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc753b1d-986c-4837-a3bd-b24455931cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.767219 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc753b1d-986c-4837-a3bd-b24455931cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.767555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc753b1d-986c-4837-a3bd-b24455931cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.767881 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc753b1d-986c-4837-a3bd-b24455931cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.768575 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc753b1d-986c-4837-a3bd-b24455931cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.794068 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc753b1d-986c-4837-a3bd-b24455931cf9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.804991 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1348/2679] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:08 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:08.811163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc753b1d-986c-4837-a3bd-b24455931cf9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:08.821160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc753b1d-986c-4837-a3bd-b24455931cf9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:08.827235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69bb3-1bfb-456d-a4e9-fda79de606a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:08.828203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69bb3-1bfb-456d-a4e9-fda79de606a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.828376 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69bb3-1bfb-456d-a4e9-fda79de606a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.828691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69bb3-1bfb-456d-a4e9-fda79de606a9 admin admin] PATH_INFO: `/v3/projects/514ed76ab9584804bfaf6a9cbe12a7b3/users/1a9cffe2656d4d298f3713fb33162808/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.833688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcb2e8-0b40-4825-b0ac-1be25f497e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.851832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed69bb3-1bfb-456d-a4e9-fda79de606a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=514ed76ab9584804bfaf6a9cbe12a7b3, user_id=1a9cffe2656d4d298f3713fb33162808, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:08.859975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcb2e8-0b40-4825-b0ac-1be25f497e05 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.870320 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1332/2680] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:08 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:51:08.879375 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed69bb3-1bfb-456d-a4e9-fda79de606a9 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:08.895044 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1349/2681] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:08 2021] PUT /identity/v3/projects/514ed76ab9584804bfaf6a9cbe12a7b3/users/1a9cffe2656d4d298f3713fb33162808/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:08.906319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b06c9d-7dcb-4018-8e87-0494a897e40f None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:08.906634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b06c9d-7dcb-4018-8e87-0494a897e40f None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:08.906915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b06c9d-7dcb-4018-8e87-0494a897e40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:08.964857 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-e4b06c9d-7dcb-4018-8e87-0494a897e40f None None] MFA Rules not processed for user `1a9cffe2656d4d298f3713fb33162808`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:08.967142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e4b06c9d-7dcb-4018-8e87-0494a897e40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:08.984888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69bb3-1bfb-456d-a4e9-fda79de606a9 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:09.057564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69bb3-1bfb-456d-a4e9-fda79de606a9 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:09.062328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3792f-8199-4311-9b38-321f60fb0fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:09.063004 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3792f-8199-4311-9b38-321f60fb0fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.063354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3792f-8199-4311-9b38-321f60fb0fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.063692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3792f-8199-4311-9b38-321f60fb0fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.064965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1333/2682] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:08 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:09.065707 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f9c3792f-8199-4311-9b38-321f60fb0fb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:09.069599 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b06c9d-7dcb-4018-8e87-0494a897e40f None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:09.145921 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b06c9d-7dcb-4018-8e87-0494a897e40f None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:09.151158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbce2e-794e-4847-b6a0-6f9df588e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:09.151768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbce2e-794e-4847-b6a0-6f9df588e30f admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.152060 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbce2e-794e-4847-b6a0-6f9df588e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.152504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbce2e-794e-4847-b6a0-6f9df588e30f admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.153292 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbce2e-794e-4847-b6a0-6f9df588e30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:09.173078 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3792f-8199-4311-9b38-321f60fb0fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:09.179504 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbce2e-794e-4847-b6a0-6f9df588e30f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:09.213527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1334/2683] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:09 2021] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:09.214648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbce2e-794e-4847-b6a0-6f9df588e30f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:09.221724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3792f-8199-4311-9b38-321f60fb0fb8 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:09.239228 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1350/2684] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:08 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:51:09.297420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbce2e-794e-4847-b6a0-6f9df588e30f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:09.301788 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4cac-f31f-45ea-9eb0-9837de4b864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:09.302429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4cac-f31f-45ea-9eb0-9837de4b864f admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.302734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4cac-f31f-45ea-9eb0-9837de4b864f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.303007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4cac-f31f-45ea-9eb0-9837de4b864f admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.303634 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a4cac-f31f-45ea-9eb0-9837de4b864f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:09.331569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a4cac-f31f-45ea-9eb0-9837de4b864f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:09.366036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1335/2685] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:09 2021] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:09.368238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3792f-8199-4311-9b38-321f60fb0fb8 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:09.380253 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3792f-8199-4311-9b38-321f60fb0fb8 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:09.386203 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da96a5d-4151-486b-8ae1-d5499dd02edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:09.387841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da96a5d-4151-486b-8ae1-d5499dd02edd admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.388339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da96a5d-4151-486b-8ae1-d5499dd02edd admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.388765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da96a5d-4151-486b-8ae1-d5499dd02edd admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.389841 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da96a5d-4151-486b-8ae1-d5499dd02edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:09.447338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da96a5d-4151-486b-8ae1-d5499dd02edd admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:09.468105 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1351/2686] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:09 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:51:09.473121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4cac-f31f-45ea-9eb0-9837de4b864f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:09.484101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4cac-f31f-45ea-9eb0-9837de4b864f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:09.489159 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b234d2-98e5-487c-99e3-22247edbbba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:09.490015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b234d2-98e5-487c-99e3-22247edbbba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.490321 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b234d2-98e5-487c-99e3-22247edbbba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.490600 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b234d2-98e5-487c-99e3-22247edbbba8 admin admin] PATH_INFO: `/v3/projects/40295103ca0a45848b01f361288777d2/users/1c05ac3a198e45b59f6b68d1ea6a5c23/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.513579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b234d2-98e5-487c-99e3-22247edbbba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40295103ca0a45848b01f361288777d2, user_id=1c05ac3a198e45b59f6b68d1ea6a5c23, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:09.540217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b234d2-98e5-487c-99e3-22247edbbba8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:09.556652 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1336/2687] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:09 2021] PUT /identity/v3/projects/40295103ca0a45848b01f361288777d2/users/1c05ac3a198e45b59f6b68d1ea6a5c23/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:09.561238 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da96a5d-4151-486b-8ae1-d5499dd02edd admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:09.572452 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da96a5d-4151-486b-8ae1-d5499dd02edd admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:09.642864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6e6f-5017-42f2-b57a-2f1e9de2a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:09.643467 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6e6f-5017-42f2-b57a-2f1e9de2a242 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.643747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6e6f-5017-42f2-b57a-2f1e9de2a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.644023 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6e6f-5017-42f2-b57a-2f1e9de2a242 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.644709 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6e6f-5017-42f2-b57a-2f1e9de2a242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:09.670496 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6e6f-5017-42f2-b57a-2f1e9de2a242 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:09.681136 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1352/2688] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:09 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:09.685769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b234d2-98e5-487c-99e3-22247edbbba8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:09.696427 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b234d2-98e5-487c-99e3-22247edbbba8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:09.701154 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6913ece-2e48-4330-be75-bb29b933c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:09.701975 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6913ece-2e48-4330-be75-bb29b933c192 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.702280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6913ece-2e48-4330-be75-bb29b933c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.702555 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6913ece-2e48-4330-be75-bb29b933c192 admin admin] PATH_INFO: `/v3/projects/40295103ca0a45848b01f361288777d2/users/1c05ac3a198e45b59f6b68d1ea6a5c23/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.704381 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6913ece-2e48-4330-be75-bb29b933c192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40295103ca0a45848b01f361288777d2, user_id=1c05ac3a198e45b59f6b68d1ea6a5c23, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:09.731194 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6913ece-2e48-4330-be75-bb29b933c192 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:09.742111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1337/2689] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:09 2021] PUT /identity/v3/projects/40295103ca0a45848b01f361288777d2/users/1c05ac3a198e45b59f6b68d1ea6a5c23/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:09.746391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6e6f-5017-42f2-b57a-2f1e9de2a242 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:09.757143 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6e6f-5017-42f2-b57a-2f1e9de2a242 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:09.824154 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c2461-40fd-4574-9188-434c3d301294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:09.824812 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c2461-40fd-4574-9188-434c3d301294 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.825100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c2461-40fd-4574-9188-434c3d301294 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.825383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c2461-40fd-4574-9188-434c3d301294 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.826130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c2461-40fd-4574-9188-434c3d301294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:09.851936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c2461-40fd-4574-9188-434c3d301294 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:09.863810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1353/2690] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:09 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:09.868394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6913ece-2e48-4330-be75-bb29b933c192 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:09.878980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6913ece-2e48-4330-be75-bb29b933c192 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:09.885632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26801-f1be-4996-a287-e2fec16e58d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:09.886503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26801-f1be-4996-a287-e2fec16e58d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.886784 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26801-f1be-4996-a287-e2fec16e58d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.887081 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26801-f1be-4996-a287-e2fec16e58d4 admin admin] PATH_INFO: `/v3/projects/40295103ca0a45848b01f361288777d2/users/1c05ac3a198e45b59f6b68d1ea6a5c23/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.889264 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26801-f1be-4996-a287-e2fec16e58d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40295103ca0a45848b01f361288777d2, user_id=1c05ac3a198e45b59f6b68d1ea6a5c23, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:09.915706 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26801-f1be-4996-a287-e2fec16e58d4 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:09.932766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1338/2691] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:09 2021] PUT /identity/v3/projects/40295103ca0a45848b01f361288777d2/users/1c05ac3a198e45b59f6b68d1ea6a5c23/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:09.945226 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa51dd4-bf25-47a1-a735-01666ad2dc01 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:09.945603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa51dd4-bf25-47a1-a735-01666ad2dc01 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:09.945927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa51dd4-bf25-47a1-a735-01666ad2dc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:09.989027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9aa51dd4-bf25-47a1-a735-01666ad2dc01 None None] MFA Rules not processed for user `1c05ac3a198e45b59f6b68d1ea6a5c23`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:09.990276 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9aa51dd4-bf25-47a1-a735-01666ad2dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:10.080251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1354/2692] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:09 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:10.086410 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26801-f1be-4996-a287-e2fec16e58d4 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:10.166132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26801-f1be-4996-a287-e2fec16e58d4 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:10.171021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:10.171829 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:10.172118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:10.172390 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] PATH_INFO: `/v3/users/1a9cffe2656d4d298f3713fb33162808` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:10.173499 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9cffe2656d4d298f3713fb33162808)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:10.199525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:10.255076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9cffe2656d4d298f3713fb33162808'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:10.269624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9cffe2656d4d298f3713fb33162808'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:10.278736 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9cffe2656d4d298f3713fb33162808'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:10.279584 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9cffe2656d4d298f3713fb33162808'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:10.288429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9cffe2656d4d298f3713fb33162808'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:10.295201 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1339/2693] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:10 2021] DELETE /identity/v3/users/1a9cffe2656d4d298f3713fb33162808 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:10.299836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb43a0a-983e-4b06-8f63-67801d00398a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:10.300131 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb43a0a-983e-4b06-8f63-67801d00398a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:10.300413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb43a0a-983e-4b06-8f63-67801d00398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:10.323038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-dcb43a0a-983e-4b06-8f63-67801d00398a None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:10.324205 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-dcb43a0a-983e-4b06-8f63-67801d00398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:10.395780 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1355/2694] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:10.407387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:10.408799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:10.485413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801352d-7aa5-4988-98a0-d1dacb225764 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:10.489877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38caf87-4ee2-4ddd-aed1-256af20f10c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:10.490527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38caf87-4ee2-4ddd-aed1-256af20f10c0 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:10.490823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38caf87-4ee2-4ddd-aed1-256af20f10c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:10.491114 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38caf87-4ee2-4ddd-aed1-256af20f10c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:10.505024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38caf87-4ee2-4ddd-aed1-256af20f10c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:10.532036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38caf87-4ee2-4ddd-aed1-256af20f10c0 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:10.542353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1340/2695] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:10.970620 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb43a0a-983e-4b06-8f63-67801d00398a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:10.971535 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-dcb43a0a-983e-4b06-8f63-67801d00398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:10.990178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb43a0a-983e-4b06-8f63-67801d00398a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:10.995562 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:10.996810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:10.997146 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:10.997432 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] PATH_INFO: `/v3/projects/514ed76ab9584804bfaf6a9cbe12a7b3` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:10.999130 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] RBAC: Authorizing `identity:delete_project(project_id=514ed76ab9584804bfaf6a9cbe12a7b3)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:11.025356 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:11.094275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514ed76ab9584804bfaf6a9cbe12a7b3', 'request_id': 'req-03496125-3b18-4f75-aed3-a9a79d91388c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.107460 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514ed76ab9584804bfaf6a9cbe12a7b3', 'request_id': 'req-03496125-3b18-4f75-aed3-a9a79d91388c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.116558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514ed76ab9584804bfaf6a9cbe12a7b3', 'request_id': 'req-03496125-3b18-4f75-aed3-a9a79d91388c'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.128884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] The token cache is being invalidate because project 514ed76ab9584804bfaf6a9cbe12a7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:11.129161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.129972 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.131468 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1356/2696] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:10 2021] DELETE /identity/v3/projects/514ed76ab9584804bfaf6a9cbe12a7b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:11.135538 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38caf87-4ee2-4ddd-aed1-256af20f10c0 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:11.148243 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38caf87-4ee2-4ddd-aed1-256af20f10c0 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:11.229208 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:11.231001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:11.231440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:11.231869 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] PATH_INFO: `/v3/users/1c05ac3a198e45b59f6b68d1ea6a5c23` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:11.233569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c05ac3a198e45b59f6b68d1ea6a5c23)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:11.260852 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:11.316104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c05ac3a198e45b59f6b68d1ea6a5c23'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.328765 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c05ac3a198e45b59f6b68d1ea6a5c23'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.336637 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c05ac3a198e45b59f6b68d1ea6a5c23'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.337343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c05ac3a198e45b59f6b68d1ea6a5c23'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.346217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-ae06bd4a-4739-4bfa-8a7c-9c01c3f0df04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c05ac3a198e45b59f6b68d1ea6a5c23'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.352543 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1341/2697] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:11 2021] DELETE /identity/v3/users/1c05ac3a198e45b59f6b68d1ea6a5c23 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:11.754728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:11.756277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:11.769473 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03496125-3b18-4f75-aed3-a9a79d91388c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:11.836810 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:11.837654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:11.837938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:11.838235 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] PATH_INFO: `/v3/projects/40295103ca0a45848b01f361288777d2` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:11.839379 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40295103ca0a45848b01f361288777d2)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:11.865202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:11.918331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40295103ca0a45848b01f361288777d2', 'request_id': 'req-51718034-bf3e-4c54-9714-f8846ac75f79'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.930195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40295103ca0a45848b01f361288777d2', 'request_id': 'req-51718034-bf3e-4c54-9714-f8846ac75f79'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.939301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40295103ca0a45848b01f361288777d2', 'request_id': 'req-51718034-bf3e-4c54-9714-f8846ac75f79'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.949440 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] The token cache is being invalidate because project 40295103ca0a45848b01f361288777d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:11.949720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.950367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-51718034-bf3e-4c54-9714-f8846ac75f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:11.951815 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1357/2698] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:11 2021] DELETE /identity/v3/projects/40295103ca0a45848b01f361288777d2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:11.961631 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e3c84-95b6-425b-8f4c-4b2263388d5e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:11.961927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e3c84-95b6-425b-8f4c-4b2263388d5e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:11.962249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e3c84-95b6-425b-8f4c-4b2263388d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:11.986501 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-af2e3c84-95b6-425b-8f4c-4b2263388d5e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:11.987665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-af2e3c84-95b6-425b-8f4c-4b2263388d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:12.056562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1342/2699] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:12.064952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8411-0fda-4761-8c4a-f0328cf94c1d None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.065475 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8411-0fda-4761-8c4a-f0328cf94c1d None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.065583 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8411-0fda-4761-8c4a-f0328cf94c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.091536 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9bab8411-0fda-4761-8c4a-f0328cf94c1d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:12.092753 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9bab8411-0fda-4761-8c4a-f0328cf94c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:12.100391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1358/2700] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:12.106936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e3c84-95b6-425b-8f4c-4b2263388d5e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:12.122101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e3c84-95b6-425b-8f4c-4b2263388d5e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:12.138911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:12.139861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.139861 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.140140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.140799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:51:12.141323 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:12.167948 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:12.187136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1343/2701] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:12.191807 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab8411-0fda-4761-8c4a-f0328cf94c1d None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:12.201170 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab8411-0fda-4761-8c4a-f0328cf94c1d None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:12.206145 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d3ca-8cd2-4106-a90a-c70be3b1f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:12.206788 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d3ca-8cd2-4106-a90a-c70be3b1f2cb admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.207058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d3ca-8cd2-4106-a90a-c70be3b1f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.207335 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d3ca-8cd2-4106-a90a-c70be3b1f2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.208025 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789d3ca-8cd2-4106-a90a-c70be3b1f2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:12.234690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789d3ca-8cd2-4106-a90a-c70be3b1f2cb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:12.248266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:12.250184 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:12.263075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce106e-ed02-4c82-8b99-3eaf7fc9850e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:12.268424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1359/2702] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:12 2021] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:12.269438 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d3ca-8cd2-4106-a90a-c70be3b1f2cb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:12.333104 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:12.333819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.334136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.334417 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] PATH_INFO: `/v3/users/13e41f62ce584a45bdc1bc4d992b9f8f` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.335551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e41f62ce584a45bdc1bc4d992b9f8f)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:12.343688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d3ca-8cd2-4106-a90a-c70be3b1f2cb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:12.348344 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236640b-12bc-469d-958e-fa83b8aee6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:12.348963 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236640b-12bc-469d-958e-fa83b8aee6ef admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.349248 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236640b-12bc-469d-958e-fa83b8aee6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.349551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236640b-12bc-469d-958e-fa83b8aee6ef admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.350234 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236640b-12bc-469d-958e-fa83b8aee6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:12.361420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:12.377402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236640b-12bc-469d-958e-fa83b8aee6ef admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:12.411805 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1360/2703] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:12 2021] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:12.416420 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236640b-12bc-469d-958e-fa83b8aee6ef admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:12.426990 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236640b-12bc-469d-958e-fa83b8aee6ef admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:12.427923 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e41f62ce584a45bdc1bc4d992b9f8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:12.431377 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e420-e53f-411d-acc1-9cd794baf6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:12.431988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e420-e53f-411d-acc1-9cd794baf6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.432267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e420-e53f-411d-acc1-9cd794baf6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.432588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e420-e53f-411d-acc1-9cd794baf6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.433429 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37e420-e53f-411d-acc1-9cd794baf6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:12.442420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e41f62ce584a45bdc1bc4d992b9f8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:12.451560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e41f62ce584a45bdc1bc4d992b9f8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:12.452379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e41f62ce584a45bdc1bc4d992b9f8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:12.460693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37e420-e53f-411d-acc1-9cd794baf6f1 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:12.461779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-27cf0f1d-448e-4ef3-8d1d-64288d7a393a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e41f62ce584a45bdc1bc4d992b9f8f'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:12.469428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1344/2704] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:12 2021] DELETE /identity/v3/users/13e41f62ce584a45bdc1bc4d992b9f8f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:12.475039 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1361/2705] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:12 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:51:12.475198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23636-016d-46c9-a475-a1a5a73babbd None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.475198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23636-016d-46c9-a475-a1a5a73babbd None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.475198 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23636-016d-46c9-a475-a1a5a73babbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.476152 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e420-e53f-411d-acc1-9cd794baf6f1 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:12.477896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3d37e420-e53f-411d-acc1-9cd794baf6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:12.491193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e420-e53f-411d-acc1-9cd794baf6f1 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:12.497945 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-c1f23636-016d-46c9-a475-a1a5a73babbd None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:12.499186 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c1f23636-016d-46c9-a475-a1a5a73babbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:12.562730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596fb05-2e9d-4a82-b3b9-3186c2d88cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:12.563635 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596fb05-2e9d-4a82-b3b9-3186c2d88cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.563912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596fb05-2e9d-4a82-b3b9-3186c2d88cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.564199 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596fb05-2e9d-4a82-b3b9-3186c2d88cd2 admin admin] PATH_INFO: `/v3/projects/90cfa1ef584f4961b859f9402af57006/users/0827c7c9f2c74cd7beb1162a4d7d7547/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.582815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1345/2706] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:12.585747 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596fb05-2e9d-4a82-b3b9-3186c2d88cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cfa1ef584f4961b859f9402af57006, user_id=0827c7c9f2c74cd7beb1162a4d7d7547, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:12.594178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f23636-016d-46c9-a475-a1a5a73babbd None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:12.595525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c1f23636-016d-46c9-a475-a1a5a73babbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:12.612703 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596fb05-2e9d-4a82-b3b9-3186c2d88cd2 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:12.628586 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1362/2707] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:12 2021] PUT /identity/v3/projects/90cfa1ef584f4961b859f9402af57006/users/0827c7c9f2c74cd7beb1162a4d7d7547/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:12.639872 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586127-befe-44be-9cba-e183b4ee606e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.640296 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586127-befe-44be-9cba-e183b4ee606e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.640427 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586127-befe-44be-9cba-e183b4ee606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.668697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f23636-016d-46c9-a475-a1a5a73babbd None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:12.681016 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-95586127-befe-44be-9cba-e183b4ee606e None None] MFA Rules not processed for user `0827c7c9f2c74cd7beb1162a4d7d7547`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:12.682231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-95586127-befe-44be-9cba-e183b4ee606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:12.731059 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f60816-44cc-41e9-a8cb-b9132fccf2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:12.731650 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f60816-44cc-41e9-a8cb-b9132fccf2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.731932 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f60816-44cc-41e9-a8cb-b9132fccf2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.732207 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f60816-44cc-41e9-a8cb-b9132fccf2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.760889 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1363/2708] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:12 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:12.771874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586127-befe-44be-9cba-e183b4ee606e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:12.773232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-95586127-befe-44be-9cba-e183b4ee606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:12.803503 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f60816-44cc-41e9-a8cb-b9132fccf2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:12.829630 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f60816-44cc-41e9-a8cb-b9132fccf2e3 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:12.840124 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1346/2709] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:51:12.842792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586127-befe-44be-9cba-e183b4ee606e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:12.846414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bfeb0-451d-4a20-b088-af9e7423bc2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:12.847005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bfeb0-451d-4a20-b088-af9e7423bc2e service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:12.847310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bfeb0-451d-4a20-b088-af9e7423bc2e service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:12.847574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bfeb0-451d-4a20-b088-af9e7423bc2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:12.856610 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bfeb0-451d-4a20-b088-af9e7423bc2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:12.882441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bfeb0-451d-4a20-b088-af9e7423bc2e service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:12.892821 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1364/2710] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:12 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:13.237947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f60816-44cc-41e9-a8cb-b9132fccf2e3 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:13.239488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c9f60816-44cc-41e9-a8cb-b9132fccf2e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:13.274763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f60816-44cc-41e9-a8cb-b9132fccf2e3 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:13.280512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:13.281345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:13.281627 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:13.282191 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] PATH_INFO: `/v3/projects/5ba9af4d4d6b4e2e8db11f46d4913f89` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:13.283854 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba9af4d4d6b4e2e8db11f46d4913f89)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:13.310647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:13.375509 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba9af4d4d6b4e2e8db11f46d4913f89', 'request_id': 'req-176f46a2-f49f-48fb-a774-2de305b2237a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.387968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba9af4d4d6b4e2e8db11f46d4913f89', 'request_id': 'req-176f46a2-f49f-48fb-a774-2de305b2237a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.397122 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba9af4d4d6b4e2e8db11f46d4913f89', 'request_id': 'req-176f46a2-f49f-48fb-a774-2de305b2237a'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.407799 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] The token cache is being invalidate because project 5ba9af4d4d6b4e2e8db11f46d4913f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:13.408087 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.408790 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.410406 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1347/2711] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:13 2021] DELETE /identity/v3/projects/5ba9af4d4d6b4e2e8db11f46d4913f89 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:13.414545 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bfeb0-451d-4a20-b088-af9e7423bc2e service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:13.425915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bfeb0-451d-4a20-b088-af9e7423bc2e service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:13.493908 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:13.494736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:13.495021 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:13.495325 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] PATH_INFO: `/v3/users/62abb197036b487d96488c93212bc2ee` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:13.496457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62abb197036b487d96488c93212bc2ee)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:13.522129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:13.578762 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62abb197036b487d96488c93212bc2ee'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.589820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62abb197036b487d96488c93212bc2ee'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.590884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62abb197036b487d96488c93212bc2ee'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.600550 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62abb197036b487d96488c93212bc2ee'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.613806 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-ef99ccff-cfb0-421d-823f-8cd0df52966d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62abb197036b487d96488c93212bc2ee'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:13.620506 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1365/2712] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:13 2021] DELETE /identity/v3/users/62abb197036b487d96488c93212bc2ee => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:14.009552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:14.011462 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:14.024535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f46a2-f49f-48fb-a774-2de305b2237a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:14.093786 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:14.094621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:14.094898 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:14.095174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] PATH_INFO: `/v3/projects/815af112391246679330fbf5bf0351f8` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:14.096409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=815af112391246679330fbf5bf0351f8)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:14.122631 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:14.179118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815af112391246679330fbf5bf0351f8', 'request_id': 'req-b1a0270e-42a6-4cc6-bf9c-631c89468367'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:14.192542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815af112391246679330fbf5bf0351f8', 'request_id': 'req-b1a0270e-42a6-4cc6-bf9c-631c89468367'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:14.207351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815af112391246679330fbf5bf0351f8', 'request_id': 'req-b1a0270e-42a6-4cc6-bf9c-631c89468367'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:14.220394 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] The token cache is being invalidate because project 815af112391246679330fbf5bf0351f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:14.220685 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:14.221354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-b1a0270e-42a6-4cc6-bf9c-631c89468367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:14.222958 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1348/2713] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:14 2021] DELETE /identity/v3/projects/815af112391246679330fbf5bf0351f8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:14.228784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0eef-983a-4be8-b615-a91e34c6febd None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:14.229076 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0eef-983a-4be8-b615-a91e34c6febd None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:14.229356 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0eef-983a-4be8-b615-a91e34c6febd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:14.253077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-8ddb0eef-983a-4be8-b615-a91e34c6febd None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:14.254269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8ddb0eef-983a-4be8-b615-a91e34c6febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:14.321939 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1366/2714] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:14.330956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ed866-741b-48c9-96f7-a14a605c3ae0 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:14.331452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ed866-741b-48c9-96f7-a14a605c3ae0 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:14.331452 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ed866-741b-48c9-96f7-a14a605c3ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:14.357451 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-963ed866-741b-48c9-96f7-a14a605c3ae0 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:14.358688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-963ed866-741b-48c9-96f7-a14a605c3ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:14.366949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1349/2715] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:14.371888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb0eef-983a-4be8-b615-a91e34c6febd None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:14.382026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb0eef-983a-4be8-b615-a91e34c6febd None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:14.387679 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162037d5-a29b-425f-b029-535994cd1914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:14.388309 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162037d5-a29b-425f-b029-535994cd1914 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:14.388601 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162037d5-a29b-425f-b029-535994cd1914 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:14.388930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162037d5-a29b-425f-b029-535994cd1914 admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:14.389653 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162037d5-a29b-425f-b029-535994cd1914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:51:14.389958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162037d5-a29b-425f-b029-535994cd1914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:14.415559 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162037d5-a29b-425f-b029-535994cd1914 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:14.434303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1367/2716] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:14.435478 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ed866-741b-48c9-96f7-a14a605c3ae0 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:14.445616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ed866-741b-48c9-96f7-a14a605c3ae0 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:14.450485 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059850d-c49b-4e4c-80c1-dc7ea1a20b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:14.451070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059850d-c49b-4e4c-80c1-dc7ea1a20b8e admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:14.451354 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059850d-c49b-4e4c-80c1-dc7ea1a20b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:14.451628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059850d-c49b-4e4c-80c1-dc7ea1a20b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:14.452283 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059850d-c49b-4e4c-80c1-dc7ea1a20b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:14.478733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059850d-c49b-4e4c-80c1-dc7ea1a20b8e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:14.511015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1350/2717] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:14 2021] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:14.515305 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162037d5-a29b-425f-b029-535994cd1914 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:14.525474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162037d5-a29b-425f-b029-535994cd1914 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:14.602184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40772f0f-358e-4d30-aba0-98ed66d21c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:14.602801 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40772f0f-358e-4d30-aba0-98ed66d21c45 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:14.603097 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40772f0f-358e-4d30-aba0-98ed66d21c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:14.603371 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40772f0f-358e-4d30-aba0-98ed66d21c45 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:14.604108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40772f0f-358e-4d30-aba0-98ed66d21c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:14.630269 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40772f0f-358e-4d30-aba0-98ed66d21c45 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:14.653488 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1368/2718] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:14 2021] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:14.658116 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059850d-c49b-4e4c-80c1-dc7ea1a20b8e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:14.669140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059850d-c49b-4e4c-80c1-dc7ea1a20b8e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:14.673779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21590a5-ad5c-4f04-95b2-5a85ddc77444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:14.674457 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21590a5-ad5c-4f04-95b2-5a85ddc77444 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:14.674741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21590a5-ad5c-4f04-95b2-5a85ddc77444 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:14.675019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21590a5-ad5c-4f04-95b2-5a85ddc77444 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:14.675730 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21590a5-ad5c-4f04-95b2-5a85ddc77444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:14.704978 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21590a5-ad5c-4f04-95b2-5a85ddc77444 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:14.716404 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1351/2719] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:14 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:14.721162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40772f0f-358e-4d30-aba0-98ed66d21c45 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:14.732604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40772f0f-358e-4d30-aba0-98ed66d21c45 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:14.738020 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed622-679f-4dfa-97b4-a14257eccca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:14.738988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed622-679f-4dfa-97b4-a14257eccca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:14.739273 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed622-679f-4dfa-97b4-a14257eccca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:14.739576 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed622-679f-4dfa-97b4-a14257eccca0 admin admin] PATH_INFO: `/v3/projects/5fe9800b08fe4ef2ae6cf2c21bf275bf/users/408c7b05f7e24d6bb55017c47a088d72/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:14.762355 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fed622-679f-4dfa-97b4-a14257eccca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe9800b08fe4ef2ae6cf2c21bf275bf, user_id=408c7b05f7e24d6bb55017c47a088d72, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:14.789785 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fed622-679f-4dfa-97b4-a14257eccca0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:14.805212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1369/2720] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:14 2021] PUT /identity/v3/projects/5fe9800b08fe4ef2ae6cf2c21bf275bf/users/408c7b05f7e24d6bb55017c47a088d72/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:14.816035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689843d4-ae0b-454d-a833-76ad38edc4c7 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:14.816329 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689843d4-ae0b-454d-a833-76ad38edc4c7 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:14.816607 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689843d4-ae0b-454d-a833-76ad38edc4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:14.855623 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-689843d4-ae0b-454d-a833-76ad38edc4c7 None None] MFA Rules not processed for user `408c7b05f7e24d6bb55017c47a088d72`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:14.856830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-689843d4-ae0b-454d-a833-76ad38edc4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:14.930693 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1352/2721] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:14 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:14.935779 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed622-679f-4dfa-97b4-a14257eccca0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.010502 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed622-679f-4dfa-97b4-a14257eccca0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.016985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96002f35-87d4-49e1-917c-83b900838c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.017719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96002f35-87d4-49e1-917c-83b900838c3c admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.018173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96002f35-87d4-49e1-917c-83b900838c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.018515 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96002f35-87d4-49e1-917c-83b900838c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.019937 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96002f35-87d4-49e1-917c-83b900838c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:15.046551 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96002f35-87d4-49e1-917c-83b900838c3c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:15.078770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1370/2722] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:14 2021] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:15.080314 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689843d4-ae0b-454d-a833-76ad38edc4c7 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.096001 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689843d4-ae0b-454d-a833-76ad38edc4c7 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.164080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8cfd6-f262-4172-ad9f-190d91b7578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.164741 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8cfd6-f262-4172-ad9f-190d91b7578e admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.165022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8cfd6-f262-4172-ad9f-190d91b7578e admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.165280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8cfd6-f262-4172-ad9f-190d91b7578e admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.165915 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8cfd6-f262-4172-ad9f-190d91b7578e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:15.196040 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8cfd6-f262-4172-ad9f-190d91b7578e admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:15.220400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1353/2723] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:15 2021] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:15.224521 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96002f35-87d4-49e1-917c-83b900838c3c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.234835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96002f35-87d4-49e1-917c-83b900838c3c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.239464 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c802ce-9f13-472d-b56b-9515963d8419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.240038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c802ce-9f13-472d-b56b-9515963d8419 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.240318 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c802ce-9f13-472d-b56b-9515963d8419 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.240608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c802ce-9f13-472d-b56b-9515963d8419 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.241297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c802ce-9f13-472d-b56b-9515963d8419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:15.267366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c802ce-9f13-472d-b56b-9515963d8419 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:15.279516 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1371/2724] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:15 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:15.284031 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8cfd6-f262-4172-ad9f-190d91b7578e admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.295103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8cfd6-f262-4172-ad9f-190d91b7578e admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.300552 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a1dd-46c5-4eb9-85e2-709c2920195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.301514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a1dd-46c5-4eb9-85e2-709c2920195d admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.301803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a1dd-46c5-4eb9-85e2-709c2920195d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.302119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a1dd-46c5-4eb9-85e2-709c2920195d admin admin] PATH_INFO: `/v3/projects/92437f19f74d452faf816d4196aa2e97/users/8017c0ebd9e045eea3dbae78f1a8466c/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.324400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9a1dd-46c5-4eb9-85e2-709c2920195d admin admin] RBAC: Authorizing `identity:create_grant(project_id=92437f19f74d452faf816d4196aa2e97, user_id=8017c0ebd9e045eea3dbae78f1a8466c, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:15.351213 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9a1dd-46c5-4eb9-85e2-709c2920195d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:15.368024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1354/2725] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:15 2021] PUT /identity/v3/projects/92437f19f74d452faf816d4196aa2e97/users/8017c0ebd9e045eea3dbae78f1a8466c/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:15.371833 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c802ce-9f13-472d-b56b-9515963d8419 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.381404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c802ce-9f13-472d-b56b-9515963d8419 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.448721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2518-dc6c-4495-824e-d82f678924b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.449451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2518-dc6c-4495-824e-d82f678924b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.449451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2518-dc6c-4495-824e-d82f678924b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.449756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2518-dc6c-4495-824e-d82f678924b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.450547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c2518-dc6c-4495-824e-d82f678924b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:15.476351 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c2518-dc6c-4495-824e-d82f678924b3 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:15.487787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1372/2726] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:15 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:15.492369 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a1dd-46c5-4eb9-85e2-709c2920195d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.503111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a1dd-46c5-4eb9-85e2-709c2920195d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.507953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136bdcd-e3b7-4610-8b8f-fd4036dd21a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.508783 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136bdcd-e3b7-4610-8b8f-fd4036dd21a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.509070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136bdcd-e3b7-4610-8b8f-fd4036dd21a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.509345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136bdcd-e3b7-4610-8b8f-fd4036dd21a5 admin admin] PATH_INFO: `/v3/projects/92437f19f74d452faf816d4196aa2e97/users/8017c0ebd9e045eea3dbae78f1a8466c/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.511477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136bdcd-e3b7-4610-8b8f-fd4036dd21a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92437f19f74d452faf816d4196aa2e97, user_id=8017c0ebd9e045eea3dbae78f1a8466c, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:15.537766 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136bdcd-e3b7-4610-8b8f-fd4036dd21a5 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:15.549515 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1355/2727] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:15 2021] PUT /identity/v3/projects/92437f19f74d452faf816d4196aa2e97/users/8017c0ebd9e045eea3dbae78f1a8466c/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:15.554167 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2518-dc6c-4495-824e-d82f678924b3 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.565394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2518-dc6c-4495-824e-d82f678924b3 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.636968 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7604b6-1c8d-42d2-a0d0-0ff0e2f5a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.637574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7604b6-1c8d-42d2-a0d0-0ff0e2f5a215 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.637860 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7604b6-1c8d-42d2-a0d0-0ff0e2f5a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.638171 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7604b6-1c8d-42d2-a0d0-0ff0e2f5a215 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.638911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7604b6-1c8d-42d2-a0d0-0ff0e2f5a215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:15.665190 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7604b6-1c8d-42d2-a0d0-0ff0e2f5a215 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:15.676644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1373/2728] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:15 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:15.681293 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136bdcd-e3b7-4610-8b8f-fd4036dd21a5 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.693527 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136bdcd-e3b7-4610-8b8f-fd4036dd21a5 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.701033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87252be-0836-40e0-a24c-2b455c8821a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.701817 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87252be-0836-40e0-a24c-2b455c8821a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.702144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87252be-0836-40e0-a24c-2b455c8821a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.702420 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87252be-0836-40e0-a24c-2b455c8821a6 admin admin] PATH_INFO: `/v3/projects/92437f19f74d452faf816d4196aa2e97/users/8017c0ebd9e045eea3dbae78f1a8466c/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.704708 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87252be-0836-40e0-a24c-2b455c8821a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92437f19f74d452faf816d4196aa2e97, user_id=8017c0ebd9e045eea3dbae78f1a8466c, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:15.731140 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87252be-0836-40e0-a24c-2b455c8821a6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:15.748142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1356/2729] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:15 2021] PUT /identity/v3/projects/92437f19f74d452faf816d4196aa2e97/users/8017c0ebd9e045eea3dbae78f1a8466c/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:15.759735 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec55bd0-f921-4a89-80cb-63570faddd9b None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.760010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec55bd0-f921-4a89-80cb-63570faddd9b None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.760344 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec55bd0-f921-4a89-80cb-63570faddd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.800719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-2ec55bd0-f921-4a89-80cb-63570faddd9b None None] MFA Rules not processed for user `8017c0ebd9e045eea3dbae78f1a8466c`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:15.801884 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2ec55bd0-f921-4a89-80cb-63570faddd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:15.837796 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87252be-0836-40e0-a24c-2b455c8821a6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.839611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-c87252be-0836-40e0-a24c-2b455c8821a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:15.884634 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1374/2730] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:15 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:15.896038 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec55bd0-f921-4a89-80cb-63570faddd9b None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:15.897362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-2ec55bd0-f921-4a89-80cb-63570faddd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:15.915111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87252be-0836-40e0-a24c-2b455c8821a6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.920722 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.921562 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.921950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.922150 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] PATH_INFO: `/v3/users/0827c7c9f2c74cd7beb1162a4d7d7547` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.923376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0827c7c9f2c74cd7beb1162a4d7d7547)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:15.949682 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:15.962349 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec55bd0-f921-4a89-80cb-63570faddd9b None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:15.966031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8388bd-1a88-44f6-9816-c68c932e464c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:15.966627 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8388bd-1a88-44f6-9816-c68c932e464c service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:15.966916 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8388bd-1a88-44f6-9816-c68c932e464c service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:15.967214 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8388bd-1a88-44f6-9816-c68c932e464c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:15.976596 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8388bd-1a88-44f6-9816-c68c932e464c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:16.002039 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0827c7c9f2c74cd7beb1162a4d7d7547'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.002649 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8388bd-1a88-44f6-9816-c68c932e464c service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:16.013031 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1375/2731] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:15 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:51:16.015749 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0827c7c9f2c74cd7beb1162a4d7d7547'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.023590 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0827c7c9f2c74cd7beb1162a4d7d7547'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.024301 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0827c7c9f2c74cd7beb1162a4d7d7547'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.033293 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0827c7c9f2c74cd7beb1162a4d7d7547'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.042106 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1357/2732] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:15 2021] DELETE /identity/v3/users/0827c7c9f2c74cd7beb1162a4d7d7547 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:16.046982 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e5fa5-96c6-4fa3-a43a-cea2e17cddee None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.047303 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e5fa5-96c6-4fa3-a43a-cea2e17cddee None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.047588 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e5fa5-96c6-4fa3-a43a-cea2e17cddee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.071275 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-9d2e5fa5-96c6-4fa3-a43a-cea2e17cddee None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:16.072755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9d2e5fa5-96c6-4fa3-a43a-cea2e17cddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:16.150160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1376/2733] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:16.160976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:16.161721 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:16.230216 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf4842-0dec-437c-827a-8cdd81ed38a8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:16.233845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c93e61-f201-4575-80a0-598cc8904a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:16.234469 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c93e61-f201-4575-80a0-598cc8904a3c service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.234754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c93e61-f201-4575-80a0-598cc8904a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.235034 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c93e61-f201-4575-80a0-598cc8904a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.245167 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c93e61-f201-4575-80a0-598cc8904a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:16.271170 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c93e61-f201-4575-80a0-598cc8904a3c service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:16.282063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1358/2734] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:16.423069 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e5fa5-96c6-4fa3-a43a-cea2e17cddee None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:16.424459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9d2e5fa5-96c6-4fa3-a43a-cea2e17cddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:16.598441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e5fa5-96c6-4fa3-a43a-cea2e17cddee None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:16.603017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8017c0ebd9e045eea3dbae78f1a8466c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92437f19f74d452faf816d4196aa2e97', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:16.603755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.604024 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.604313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.605002 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:51:16.605307 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:16.631261 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:16.644181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1377/2735] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:51:16.648434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c93e61-f201-4575-80a0-598cc8904a3c service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:16.658569 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c93e61-f201-4575-80a0-598cc8904a3c service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:16.662865 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacc5a9-7f92-4876-bbae-4c8b9bfaf476 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8017c0ebd9e045eea3dbae78f1a8466c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92437f19f74d452faf816d4196aa2e97', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:16.663345 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacc5a9-7f92-4876-bbae-4c8b9bfaf476 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.663643 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacc5a9-7f92-4876-bbae-4c8b9bfaf476 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.663926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacc5a9-7f92-4876-bbae-4c8b9bfaf476 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.664575 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacc5a9-7f92-4876-bbae-4c8b9bfaf476 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:16.679345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:16.680974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:16.691582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacc5a9-7f92-4876-bbae-4c8b9bfaf476 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:16.694706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb18d8-cfa7-4e75-8be8-af34c7e19c88 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:16.700825 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:16.701674 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.701957 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.702281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] PATH_INFO: `/v3/projects/90cfa1ef584f4961b859f9402af57006` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.703397 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=90cfa1ef584f4961b859f9402af57006)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:16.722300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1359/2736] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:16 2021] POST /identity/v3/projects => generated 354 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:16.726432 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacc5a9-7f92-4876-bbae-4c8b9bfaf476 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:16.730339 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:16.784173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90cfa1ef584f4961b859f9402af57006', 'request_id': 'req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.798330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90cfa1ef584f4961b859f9402af57006', 'request_id': 'req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.802483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacc5a9-7f92-4876-bbae-4c8b9bfaf476 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:16.807724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90cfa1ef584f4961b859f9402af57006', 'request_id': 'req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.818398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] The token cache is being invalidate because project 90cfa1ef584f4961b859f9402af57006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:16.818717 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.819330 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-33a635bd-ed88-44c1-a6ca-49a01e4eee1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:16.821119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1378/2737] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:16 2021] DELETE /identity/v3/projects/90cfa1ef584f4961b859f9402af57006 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:16.827099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab8ef8-aac3-4661-ade3-f69b0ab1b800 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.827384 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab8ef8-aac3-4661-ade3-f69b0ab1b800 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.827662 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab8ef8-aac3-4661-ade3-f69b0ab1b800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.854396 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-44ab8ef8-aac3-4661-ade3-f69b0ab1b800 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:16.855633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-44ab8ef8-aac3-4661-ade3-f69b0ab1b800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:16.873096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dd7c8-21a5-4b93-ac6a-a57add3afb91 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8017c0ebd9e045eea3dbae78f1a8466c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92437f19f74d452faf816d4196aa2e97', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:16.873713 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd7c8-21a5-4b93-ac6a-a57add3afb91 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.874015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd7c8-21a5-4b93-ac6a-a57add3afb91 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.874308 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd7c8-21a5-4b93-ac6a-a57add3afb91 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.875009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd7c8-21a5-4b93-ac6a-a57add3afb91 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:51:16.875463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd7c8-21a5-4b93-ac6a-a57add3afb91 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:16.902326 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd7c8-21a5-4b93-ac6a-a57add3afb91 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:16.915079 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1360/2738] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:16.927191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1379/2739] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:16.936588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a284-f556-4665-8ac9-fdf55362fca4 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.936918 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a284-f556-4665-8ac9-fdf55362fca4 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.937551 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a284-f556-4665-8ac9-fdf55362fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.956281 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab8ef8-aac3-4661-ade3-f69b0ab1b800 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:16.957818 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-44ab8ef8-aac3-4661-ade3-f69b0ab1b800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:16.963561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-d5d6a284-f556-4665-8ac9-fdf55362fca4 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:16.964769 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d5d6a284-f556-4665-8ac9-fdf55362fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:16.971306 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab8ef8-aac3-4661-ade3-f69b0ab1b800 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:16.972633 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1361/2740] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:16.975915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8017c0ebd9e045eea3dbae78f1a8466c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92437f19f74d452faf816d4196aa2e97', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:16.976499 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.976911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a284-f556-4665-8ac9-fdf55362fca4 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:16.977056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.977056 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] PATH_INFO: `/v3/projects/9f1cc375cf0249e3bf7d3c5133a18997` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.978245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f1cc375cf0249e3bf7d3c5133a18997)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:16.986353 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a284-f556-4665-8ac9-fdf55362fca4 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:16.991047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba65e61-f148-497f-968f-7b012625faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:16.991642 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba65e61-f148-497f-968f-7b012625faf1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:16.991925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba65e61-f148-497f-968f-7b012625faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:16.992193 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba65e61-f148-497f-968f-7b012625faf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:16.992883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba65e61-f148-497f-968f-7b012625faf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:51:16.993289 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba65e61-f148-497f-968f-7b012625faf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:17.004555 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:17.019263 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba65e61-f148-497f-968f-7b012625faf1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:17.033237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1362/2741] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 16 14:51:17.037856 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba65e61-f148-497f-968f-7b012625faf1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:17.048162 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba65e61-f148-497f-968f-7b012625faf1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:17.062398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1cc375cf0249e3bf7d3c5133a18997', 'request_id': 'req-0bde0bc8-6ac5-4391-bb39-68419786a295'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.074725 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1cc375cf0249e3bf7d3c5133a18997', 'request_id': 'req-0bde0bc8-6ac5-4391-bb39-68419786a295'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.084731 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1cc375cf0249e3bf7d3c5133a18997', 'request_id': 'req-0bde0bc8-6ac5-4391-bb39-68419786a295'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.096984 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] The token cache is being invalidate because project 9f1cc375cf0249e3bf7d3c5133a18997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:17.097358 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.098060 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.103059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1380/2742] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:16 2021] DELETE /identity/v3/projects/9f1cc375cf0249e3bf7d3c5133a18997 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:17.130399 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8797a-00f4-4a49-b886-22d0939614ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:17.131416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8797a-00f4-4a49-b886-22d0939614ce admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:17.131882 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8797a-00f4-4a49-b886-22d0939614ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:17.132319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8797a-00f4-4a49-b886-22d0939614ce admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:17.133568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8797a-00f4-4a49-b886-22d0939614ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:17.171230 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8797a-00f4-4a49-b886-22d0939614ce admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:17.202036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1363/2743] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:17 2021] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:17.205531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:17.207469 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:17.227783 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde0bc8-6ac5-4391-bb39-68419786a295 tempest-VolumeQuotaClassesTest-179094468 tempest-VolumeQuotaClassesTest-179094468-project-admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:17.293195 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9db159-5a6e-48c3-ba71-a711bb4ec889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:17.293729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9db159-5a6e-48c3-ba71-a711bb4ec889 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:17.294054 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9db159-5a6e-48c3-ba71-a711bb4ec889 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:17.294352 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9db159-5a6e-48c3-ba71-a711bb4ec889 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:17.295013 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9db159-5a6e-48c3-ba71-a711bb4ec889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:17.320847 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9db159-5a6e-48c3-ba71-a711bb4ec889 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:17.344746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1381/2744] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:17 2021] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:17.353236 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8797a-00f4-4a49-b886-22d0939614ce admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:17.366379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8797a-00f4-4a49-b886-22d0939614ce admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:17.370928 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3e26d-df78-4096-9508-a8a727b0235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:17.371550 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3e26d-df78-4096-9508-a8a727b0235d admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:17.371823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3e26d-df78-4096-9508-a8a727b0235d admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:17.372095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3e26d-df78-4096-9508-a8a727b0235d admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:17.372794 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3e26d-df78-4096-9508-a8a727b0235d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:17.381454 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9db159-5a6e-48c3-ba71-a711bb4ec889 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:17.383192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ce9db159-5a6e-48c3-ba71-a711bb4ec889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:17.395231 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9db159-5a6e-48c3-ba71-a711bb4ec889 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:17.398778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3e26d-df78-4096-9508-a8a727b0235d admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:17.400163 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:17.401712 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:17.402042 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:17.402311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] PATH_INFO: `/v3/users/408c7b05f7e24d6bb55017c47a088d72` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:17.403787 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408c7b05f7e24d6bb55017c47a088d72)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:17.415070 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1364/2745] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:17 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:51:17.419593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3e26d-df78-4096-9508-a8a727b0235d admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:17.429517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3e26d-df78-4096-9508-a8a727b0235d admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:17.429976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:17.434470 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bf49e-8054-4c9a-9b4f-08ad9fc5b3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:17.435338 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bf49e-8054-4c9a-9b4f-08ad9fc5b3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:17.435654 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bf49e-8054-4c9a-9b4f-08ad9fc5b3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:17.435969 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bf49e-8054-4c9a-9b4f-08ad9fc5b3f8 admin admin] PATH_INFO: `/v3/projects/5497f03113bd435d9b101817e624fa38/users/16582188a9d148a58da4364890bace4c/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:17.457517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bf49e-8054-4c9a-9b4f-08ad9fc5b3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5497f03113bd435d9b101817e624fa38, user_id=16582188a9d148a58da4364890bace4c, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:17.484741 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408c7b05f7e24d6bb55017c47a088d72'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.485336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bf49e-8054-4c9a-9b4f-08ad9fc5b3f8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:17.493390 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408c7b05f7e24d6bb55017c47a088d72'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.494133 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408c7b05f7e24d6bb55017c47a088d72'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.498858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1365/2746] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:17 2021] PUT /identity/v3/projects/5497f03113bd435d9b101817e624fa38/users/16582188a9d148a58da4364890bace4c/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:17.502547 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408c7b05f7e24d6bb55017c47a088d72'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.509872 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c92dd5-501e-4f9a-9278-3ac89c62dea5 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:17.510316 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c92dd5-501e-4f9a-9278-3ac89c62dea5 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:17.510883 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c92dd5-501e-4f9a-9278-3ac89c62dea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:17.514504 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-9213acc8-2092-43cc-a435-3699c9d5bfa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408c7b05f7e24d6bb55017c47a088d72'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:17.520374 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1382/2747] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:17 2021] DELETE /identity/v3/users/408c7b05f7e24d6bb55017c47a088d72 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:17.526899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ec96-bcd7-43f1-800b-8cf16f441366 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:17.527186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ec96-bcd7-43f1-800b-8cf16f441366 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:17.527466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ec96-bcd7-43f1-800b-8cf16f441366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:17.547950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-86c92dd5-501e-4f9a-9278-3ac89c62dea5 None None] MFA Rules not processed for user `16582188a9d148a58da4364890bace4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:17.549008 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-86c92dd5-501e-4f9a-9278-3ac89c62dea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:17.551886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-3824ec96-bcd7-43f1-800b-8cf16f441366 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:17.553001 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3824ec96-bcd7-43f1-800b-8cf16f441366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:17.619903 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1383/2748] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:17.623477 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1366/2749] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:17 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:17.630365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ec96-bcd7-43f1-800b-8cf16f441366 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:17.631912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3824ec96-bcd7-43f1-800b-8cf16f441366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:17.633701 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c92dd5-501e-4f9a-9278-3ac89c62dea5 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:17.635650 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-86c92dd5-501e-4f9a-9278-3ac89c62dea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:17.718885 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ec96-bcd7-43f1-800b-8cf16f441366 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:17.722614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcc883-8afd-45a2-a842-eaaa27f6c429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:17.723202 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcc883-8afd-45a2-a842-eaaa27f6c429 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:17.723484 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcc883-8afd-45a2-a842-eaaa27f6c429 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:17.723759 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcc883-8afd-45a2-a842-eaaa27f6c429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:17.725946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c92dd5-501e-4f9a-9278-3ac89c62dea5 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:17.731310 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e7f0-5953-4745-b84b-262b28042ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:17.732237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e7f0-5953-4745-b84b-262b28042ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:17.732695 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e7f0-5953-4745-b84b-262b28042ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:17.733137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e7f0-5953-4745-b84b-262b28042ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:17.734285 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcc883-8afd-45a2-a842-eaaa27f6c429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:17.746825 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59e7f0-5953-4745-b84b-262b28042ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:17.760157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcc883-8afd-45a2-a842-eaaa27f6c429 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:17.770212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1384/2750] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:51:17.794101 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59e7f0-5953-4745-b84b-262b28042ce7 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:17.804088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1367/2751] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:17 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:18.176402 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcc883-8afd-45a2-a842-eaaa27f6c429 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:18.178169 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-99dcc883-8afd-45a2-a842-eaaa27f6c429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:18.193032 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcc883-8afd-45a2-a842-eaaa27f6c429 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:18.199501 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:18.200587 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:18.200866 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:18.201115 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] PATH_INFO: `/v3/projects/5fe9800b08fe4ef2ae6cf2c21bf275bf` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:18.202311 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe9800b08fe4ef2ae6cf2c21bf275bf)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:18.229518 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:18.289864 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe9800b08fe4ef2ae6cf2c21bf275bf', 'request_id': 'req-d5bdf05e-6859-4dba-88c7-b14777dae879'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.302070 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe9800b08fe4ef2ae6cf2c21bf275bf', 'request_id': 'req-d5bdf05e-6859-4dba-88c7-b14777dae879'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.312490 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe9800b08fe4ef2ae6cf2c21bf275bf', 'request_id': 'req-d5bdf05e-6859-4dba-88c7-b14777dae879'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.325129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] The token cache is being invalidate because project 5fe9800b08fe4ef2ae6cf2c21bf275bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:18.325347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.326077 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.327643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1385/2752] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:18 2021] DELETE /identity/v3/projects/5fe9800b08fe4ef2ae6cf2c21bf275bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:18.332964 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e7f0-5953-4745-b84b-262b28042ce7 service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:18.347911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e7f0-5953-4745-b84b-262b28042ce7 service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:18.422135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:18.422988 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:18.423266 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:18.423545 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] PATH_INFO: `/v3/users/8017c0ebd9e045eea3dbae78f1a8466c` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:18.424689 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8017c0ebd9e045eea3dbae78f1a8466c)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:18.451103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:18.503525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8017c0ebd9e045eea3dbae78f1a8466c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.515326 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8017c0ebd9e045eea3dbae78f1a8466c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.522819 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8017c0ebd9e045eea3dbae78f1a8466c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.523525 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8017c0ebd9e045eea3dbae78f1a8466c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.532174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-49ad3fd7-df9e-4911-aab4-e1d7427e4c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8017c0ebd9e045eea3dbae78f1a8466c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:18.538085 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1368/2753] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:18 2021] DELETE /identity/v3/users/8017c0ebd9e045eea3dbae78f1a8466c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:18.911669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:18.913310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:18.927915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf05e-6859-4dba-88c7-b14777dae879 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:18.994721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:18.995529 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:18.995814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:18.996095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] PATH_INFO: `/v3/projects/92437f19f74d452faf816d4196aa2e97` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:18.997259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92437f19f74d452faf816d4196aa2e97)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:19.022940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:19.075994 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92437f19f74d452faf816d4196aa2e97', 'request_id': 'req-7d62ef67-ef8c-45da-89b8-90898b41ceb7'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:19.091510 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92437f19f74d452faf816d4196aa2e97', 'request_id': 'req-7d62ef67-ef8c-45da-89b8-90898b41ceb7'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:19.101028 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92437f19f74d452faf816d4196aa2e97', 'request_id': 'req-7d62ef67-ef8c-45da-89b8-90898b41ceb7'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:19.115965 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] The token cache is being invalidate because project 92437f19f74d452faf816d4196aa2e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:19.116268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:19.116932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-7d62ef67-ef8c-45da-89b8-90898b41ceb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:19.118479 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1386/2754] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:18 2021] DELETE /identity/v3/projects/92437f19f74d452faf816d4196aa2e97 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:19.124644 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ed4d2-c439-4172-98cd-17fd3628c052 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:19.125498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ed4d2-c439-4172-98cd-17fd3628c052 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:19.125498 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ed4d2-c439-4172-98cd-17fd3628c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:19.149300 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-150ed4d2-c439-4172-98cd-17fd3628c052 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:19.150531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-150ed4d2-c439-4172-98cd-17fd3628c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:19.218611 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1369/2755] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:19.226724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fff33-87a0-4bbd-a39b-2994ffef9ef2 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:19.227017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fff33-87a0-4bbd-a39b-2994ffef9ef2 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:19.227292 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fff33-87a0-4bbd-a39b-2994ffef9ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:19.252876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-d10fff33-87a0-4bbd-a39b-2994ffef9ef2 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:19.254080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-d10fff33-87a0-4bbd-a39b-2994ffef9ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:19.263451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1387/2756] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:19.267900 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ed4d2-c439-4172-98cd-17fd3628c052 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:19.278178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ed4d2-c439-4172-98cd-17fd3628c052 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:19.282508 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084846f-f4e3-41f9-97fd-e3852aef169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:19.283096 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084846f-f4e3-41f9-97fd-e3852aef169a admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:19.283374 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084846f-f4e3-41f9-97fd-e3852aef169a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:19.283647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084846f-f4e3-41f9-97fd-e3852aef169a admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:19.284419 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084846f-f4e3-41f9-97fd-e3852aef169a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:51:19.284709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084846f-f4e3-41f9-97fd-e3852aef169a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:19.310343 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084846f-f4e3-41f9-97fd-e3852aef169a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:19.324737 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1370/2757] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:19.330394 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fff33-87a0-4bbd-a39b-2994ffef9ef2 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:19.345813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fff33-87a0-4bbd-a39b-2994ffef9ef2 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:19.350754 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c876c5-84cd-4631-b5e3-f7777ac21e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:19.351372 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c876c5-84cd-4631-b5e3-f7777ac21e79 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:19.351655 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c876c5-84cd-4631-b5e3-f7777ac21e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:19.351930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c876c5-84cd-4631-b5e3-f7777ac21e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:19.352564 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c876c5-84cd-4631-b5e3-f7777ac21e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:19.379439 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c876c5-84cd-4631-b5e3-f7777ac21e79 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:19.395488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a67906-147f-4d43-98b8-7f8e5e1212fd None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:19.395779 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a67906-147f-4d43-98b8-7f8e5e1212fd None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:19.396086 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a67906-147f-4d43-98b8-7f8e5e1212fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:19.415534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1388/2758] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:19 2021] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:19.416647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c876c5-84cd-4631-b5e3-f7777ac21e79 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:19.420119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-84a67906-147f-4d43-98b8-7f8e5e1212fd None None] MFA Rules not processed for user `16582188a9d148a58da4364890bace4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:19.421271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-84a67906-147f-4d43-98b8-7f8e5e1212fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:19.487129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1371/2759] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:19 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:19.495297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c876c5-84cd-4631-b5e3-f7777ac21e79 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:19.500514 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593a3e7-c34b-4403-9706-d9ce917d221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:19.501158 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593a3e7-c34b-4403-9706-d9ce917d221c admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:19.501447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593a3e7-c34b-4403-9706-d9ce917d221c admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:19.501729 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593a3e7-c34b-4403-9706-d9ce917d221c admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:19.502718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593a3e7-c34b-4403-9706-d9ce917d221c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:19.529193 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593a3e7-c34b-4403-9706-d9ce917d221c admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:19.551927 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1389/2760] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:19 2021] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:19.556267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a67906-147f-4d43-98b8-7f8e5e1212fd None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:19.567183 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a67906-147f-4d43-98b8-7f8e5e1212fd None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:19.571613 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba7912-0c2e-472f-a743-77158aca41aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:19.572534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba7912-0c2e-472f-a743-77158aca41aa admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:19.572534 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba7912-0c2e-472f-a743-77158aca41aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:19.572859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba7912-0c2e-472f-a743-77158aca41aa admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:19.573495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba7912-0c2e-472f-a743-77158aca41aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:19.599304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba7912-0c2e-472f-a743-77158aca41aa admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:19.610778 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1372/2761] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:19 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:19.614767 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593a3e7-c34b-4403-9706-d9ce917d221c admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:19.625627 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593a3e7-c34b-4403-9706-d9ce917d221c admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:19.630137 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e7ee5-5256-406f-8231-22973d3c6ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:19.631058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e7ee5-5256-406f-8231-22973d3c6ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:19.631412 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e7ee5-5256-406f-8231-22973d3c6ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:19.631755 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e7ee5-5256-406f-8231-22973d3c6ed0 admin admin] PATH_INFO: `/v3/projects/7a307ead03d541dfb49a5de694ba6e44/users/a9bbc0e3b4574973b2dbe26888cdd1a8/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:19.653121 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e7ee5-5256-406f-8231-22973d3c6ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a307ead03d541dfb49a5de694ba6e44, user_id=a9bbc0e3b4574973b2dbe26888cdd1a8, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:19.681095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e7ee5-5256-406f-8231-22973d3c6ed0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:19.696766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1390/2762] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:19 2021] PUT /identity/v3/projects/7a307ead03d541dfb49a5de694ba6e44/users/a9bbc0e3b4574973b2dbe26888cdd1a8/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:51:19.708618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1192ab-83eb-4140-8072-9fe8efb578ec None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:19.708911 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1192ab-83eb-4140-8072-9fe8efb578ec None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:19.709192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1192ab-83eb-4140-8072-9fe8efb578ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:19.836133 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-1b1192ab-83eb-4140-8072-9fe8efb578ec None None] MFA Rules not processed for user `a9bbc0e3b4574973b2dbe26888cdd1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:19.837409 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1b1192ab-83eb-4140-8072-9fe8efb578ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:19.913672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1373/2763] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:19 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:19.925846 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e7ee5-5256-406f-8231-22973d3c6ed0 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:19.927684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5b8e7ee5-5256-406f-8231-22973d3c6ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:20.022756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e7ee5-5256-406f-8231-22973d3c6ed0 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:20.027537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6545dc-3471-4b36-bc92-287808bb7799 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b797c99041b4e9c9cde7d0064013fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:20.028288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6545dc-3471-4b36-bc92-287808bb7799 service glance] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:20.028556 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6545dc-3471-4b36-bc92-287808bb7799 service glance] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:20.028892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6545dc-3471-4b36-bc92-287808bb7799 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:20.041697 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6545dc-3471-4b36-bc92-287808bb7799 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:20.067784 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6545dc-3471-4b36-bc92-287808bb7799 service glance] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:20.079239 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1391/2764] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:19 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:37.249282 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adf757-149b-4afd-95c7-5335d603b439 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:37.249934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adf757-149b-4afd-95c7-5335d603b439 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:37.249934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adf757-149b-4afd-95c7-5335d603b439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:37.345739 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b6adf757-149b-4afd-95c7-5335d603b439 None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:37.346847 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b6adf757-149b-4afd-95c7-5335d603b439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:37.458672 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1374/2765] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:51:37 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:37.509220 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6545dc-3471-4b36-bc92-287808bb7799 service glance] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:37.510925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3a6545dc-3471-4b36-bc92-287808bb7799 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:37.626988 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6545dc-3471-4b36-bc92-287808bb7799 service glance] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:37.633198 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1defb-ef88-45c9-81d5-98e2a83a70ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:37.633828 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1defb-ef88-45c9-81d5-98e2a83a70ba service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:37.634164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1defb-ef88-45c9-81d5-98e2a83a70ba service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:37.634443 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1defb-ef88-45c9-81d5-98e2a83a70ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:37.643643 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1defb-ef88-45c9-81d5-98e2a83a70ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:37.671178 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1defb-ef88-45c9-81d5-98e2a83a70ba service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:37.681457 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1392/2766] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:51:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:38.276976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b5ed3-adaf-462b-be81-a7976b77389b None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:38.277463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b5ed3-adaf-462b-be81-a7976b77389b None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:38.277615 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b5ed3-adaf-462b-be81-a7976b77389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:38.305772 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-777b5ed3-adaf-462b-be81-a7976b77389b None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:38.307161 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-777b5ed3-adaf-462b-be81-a7976b77389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:38.314767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1375/2767] 10.222.0.67 () {58 vars in 967 bytes} [Thu Dec 16 14:51:38 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:38.329896 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1defb-ef88-45c9-81d5-98e2a83a70ba service swift] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:38.340746 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1defb-ef88-45c9-81d5-98e2a83a70ba service swift] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:38.345297 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c7125-31d1-4e1f-88b6-4dacea4fb0cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:38.345874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c7125-31d1-4e1f-88b6-4dacea4fb0cf service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:38.346187 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c7125-31d1-4e1f-88b6-4dacea4fb0cf service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:38.346465 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c7125-31d1-4e1f-88b6-4dacea4fb0cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:38.355328 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c7125-31d1-4e1f-88b6-4dacea4fb0cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:38.380730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c7125-31d1-4e1f-88b6-4dacea4fb0cf service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:38.389658 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1393/2768] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:51:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:38.606972 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cb7d8-e622-4968-87a6-d76c7cb2b4b3 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:38.607294 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cb7d8-e622-4968-87a6-d76c7cb2b4b3 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:38.607573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cb7d8-e622-4968-87a6-d76c7cb2b4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:38.631632 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-fa8cb7d8-e622-4968-87a6-d76c7cb2b4b3 None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:38.632814 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-fa8cb7d8-e622-4968-87a6-d76c7cb2b4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:38.640317 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1376/2769] 10.222.0.67 () {58 vars in 1014 bytes} [Thu Dec 16 14:51:38 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:38.652512 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c7125-31d1-4e1f-88b6-4dacea4fb0cf service swift] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:38.663001 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c7125-31d1-4e1f-88b6-4dacea4fb0cf service swift] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:38.667531 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643eb8f-a326-4c4e-bbbe-21e9649d9966 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:38.668101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643eb8f-a326-4c4e-bbbe-21e9649d9966 service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:38.668388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643eb8f-a326-4c4e-bbbe-21e9649d9966 service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:38.668687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643eb8f-a326-4c4e-bbbe-21e9649d9966 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:38.676911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643eb8f-a326-4c4e-bbbe-21e9649d9966 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:38.702736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643eb8f-a326-4c4e-bbbe-21e9649d9966 service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:38.711451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1394/2770] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:51:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:39.060659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626760c7-32b7-4562-81ae-8e7419e40e66 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:39.060952 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626760c7-32b7-4562-81ae-8e7419e40e66 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:39.061226 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626760c7-32b7-4562-81ae-8e7419e40e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:39.085181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-626760c7-32b7-4562-81ae-8e7419e40e66 None None] MFA Rules not processed for user `64742f0f7cf443f3ac3cc5505db446eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:39.086408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-626760c7-32b7-4562-81ae-8e7419e40e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:39.093827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1377/2771] 10.222.0.67 () {58 vars in 967 bytes} [Thu Dec 16 14:51:39 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:39.105922 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643eb8f-a326-4c4e-bbbe-21e9649d9966 service swift] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:39.117107 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643eb8f-a326-4c4e-bbbe-21e9649d9966 service swift] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:39.122489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4fa8-1de2-42ce-8f0c-9edadfa8c80d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f757256b0c684c61a90421d1aec1d31d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:39.123099 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4fa8-1de2-42ce-8f0c-9edadfa8c80d service swift] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:39.123387 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4fa8-1de2-42ce-8f0c-9edadfa8c80d service swift] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:39.123675 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4fa8-1de2-42ce-8f0c-9edadfa8c80d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:39.133150 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4fa8-1de2-42ce-8f0c-9edadfa8c80d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:39.159820 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4fa8-1de2-42ce-8f0c-9edadfa8c80d service swift] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:39.169308 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1395/2772] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Dec 16 14:51:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:41.896919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626760c7-32b7-4562-81ae-8e7419e40e66 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:41.899203 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-626760c7-32b7-4562-81ae-8e7419e40e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:41.996472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626760c7-32b7-4562-81ae-8e7419e40e66 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:42.001596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:42.002640 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:42.002999 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:42.003280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] PATH_INFO: `/v3/users/16582188a9d148a58da4364890bace4c` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:42.004601 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] RBAC: Authorizing `identity:delete_user(user_id=16582188a9d148a58da4364890bace4c)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:42.030907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:42.093616 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16582188a9d148a58da4364890bace4c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.109262 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16582188a9d148a58da4364890bace4c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.119884 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16582188a9d148a58da4364890bace4c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.120828 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16582188a9d148a58da4364890bace4c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.131757 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16582188a9d148a58da4364890bace4c'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.144271 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1378/2773] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:41 2021] DELETE /identity/v3/users/16582188a9d148a58da4364890bace4c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:42.149489 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a554-7210-46a3-8da5-f5dcd127084e None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:42.150569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a554-7210-46a3-8da5-f5dcd127084e None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:42.150569 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a554-7210-46a3-8da5-f5dcd127084e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:42.176941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-7b07a554-7210-46a3-8da5-f5dcd127084e None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:42.178162 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7b07a554-7210-46a3-8da5-f5dcd127084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:42.250947 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1396/2774] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:42.261878 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:42.263333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:42.344277 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afc7c6-40d8-411e-8d21-30497f9287be admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:42.348987 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b871a6-17cb-4002-a088-ca9bfc736e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:42.349583 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b871a6-17cb-4002-a088-ca9bfc736e38 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:42.349908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b871a6-17cb-4002-a088-ca9bfc736e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:42.350261 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b871a6-17cb-4002-a088-ca9bfc736e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:42.360370 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b871a6-17cb-4002-a088-ca9bfc736e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:42.387579 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b871a6-17cb-4002-a088-ca9bfc736e38 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:42.398728 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1379/2775] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:42.686461 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07a554-7210-46a3-8da5-f5dcd127084e None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:42.689405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-7b07a554-7210-46a3-8da5-f5dcd127084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:42.706598 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07a554-7210-46a3-8da5-f5dcd127084e None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:42.712304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:42.713120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:42.713462 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:42.713690 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] PATH_INFO: `/v3/projects/5497f03113bd435d9b101817e624fa38` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:42.715101 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5497f03113bd435d9b101817e624fa38)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:42.741826 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:42.809310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5497f03113bd435d9b101817e624fa38', 'request_id': 'req-42aab196-7693-4f1d-9715-9216e6b3277e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.822359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5497f03113bd435d9b101817e624fa38', 'request_id': 'req-42aab196-7693-4f1d-9715-9216e6b3277e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.831880 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5497f03113bd435d9b101817e624fa38', 'request_id': 'req-42aab196-7693-4f1d-9715-9216e6b3277e'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.842951 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] The token cache is being invalidate because project 5497f03113bd435d9b101817e624fa38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:42.843213 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.843842 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-42aab196-7693-4f1d-9715-9216e6b3277e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:42.846204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1397/2776] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:42 2021] DELETE /identity/v3/projects/5497f03113bd435d9b101817e624fa38 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:47.762157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b871a6-17cb-4002-a088-ca9bfc736e38 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:47.764067 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-62b871a6-17cb-4002-a088-ca9bfc736e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:47.779742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b871a6-17cb-4002-a088-ca9bfc736e38 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:47.854088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:47.854946 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:47.855284 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:47.855488 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] PATH_INFO: `/v3/users/a9bbc0e3b4574973b2dbe26888cdd1a8` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:47.856746 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9bbc0e3b4574973b2dbe26888cdd1a8)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:47.883289 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:47.945036 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9bbc0e3b4574973b2dbe26888cdd1a8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:47.961733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9bbc0e3b4574973b2dbe26888cdd1a8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:47.970501 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9bbc0e3b4574973b2dbe26888cdd1a8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:47.971332 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9bbc0e3b4574973b2dbe26888cdd1a8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:47.980830 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9bbc0e3b4574973b2dbe26888cdd1a8'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:47.988359 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1380/2777] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:47 2021] DELETE /identity/v3/users/a9bbc0e3b4574973b2dbe26888cdd1a8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:47.994140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39b377-ffb7-400b-9583-85fe35c443ca None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:47.994721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39b377-ffb7-400b-9583-85fe35c443ca None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:47.994721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39b377-ffb7-400b-9583-85fe35c443ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:48.019935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-8a39b377-ffb7-400b-9583-85fe35c443ca None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:48.021480 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8a39b377-ffb7-400b-9583-85fe35c443ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:48.099738 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1398/2778] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:48.110670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:48.112461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:48.188336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160e7cc-f3fc-45e1-b639-e53bbd0f6f95 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:48.194458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b223e82-e6ab-498c-b1a8-c42394c33456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:48.195055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223e82-e6ab-498c-b1a8-c42394c33456 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:48.195845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223e82-e6ab-498c-b1a8-c42394c33456 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:48.195845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223e82-e6ab-498c-b1a8-c42394c33456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:48.205823 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b223e82-e6ab-498c-b1a8-c42394c33456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:48.234560 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b223e82-e6ab-498c-b1a8-c42394c33456 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:48.248042 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1381/2779] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:48.654876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39b377-ffb7-400b-9583-85fe35c443ca None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:48.656353 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-8a39b377-ffb7-400b-9583-85fe35c443ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:48.668602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39b377-ffb7-400b-9583-85fe35c443ca None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:48.673470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:48.674313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:48.674604 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:48.674874 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] PATH_INFO: `/v3/projects/7a307ead03d541dfb49a5de694ba6e44` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:48.676011 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a307ead03d541dfb49a5de694ba6e44)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:48.702445 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:48.759254 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a307ead03d541dfb49a5de694ba6e44', 'request_id': 'req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:48.772052 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a307ead03d541dfb49a5de694ba6e44', 'request_id': 'req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:48.782034 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a307ead03d541dfb49a5de694ba6e44', 'request_id': 'req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:48.793951 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] The token cache is being invalidate because project 7a307ead03d541dfb49a5de694ba6e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:51:48.794268 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:48.794904 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-c8c9bf67-50d7-4c73-a3ee-34a3cda89568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:48.796359 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1399/2780] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:48 2021] DELETE /identity/v3/projects/7a307ead03d541dfb49a5de694ba6e44 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:48.802536 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0ca36-a4c6-4831-83f9-bb52a7e6182d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:48.803048 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0ca36-a4c6-4831-83f9-bb52a7e6182d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:48.803146 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0ca36-a4c6-4831-83f9-bb52a7e6182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:48.829891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-0ce0ca36-a4c6-4831-83f9-bb52a7e6182d None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:48.831132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-0ce0ca36-a4c6-4831-83f9-bb52a7e6182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:48.901411 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1382/2781] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:51:48.909424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f506bd-b753-4cf5-ae58-8190b0e5a010 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:48.909713 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f506bd-b753-4cf5-ae58-8190b0e5a010 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:48.910017 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f506bd-b753-4cf5-ae58-8190b0e5a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:48.945327 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-f1f506bd-b753-4cf5-ae58-8190b0e5a010 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:48.947258 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-f1f506bd-b753-4cf5-ae58-8190b0e5a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:48.957053 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1400/2782] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:48.961977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0ca36-a4c6-4831-83f9-bb52a7e6182d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:48.976009 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0ca36-a4c6-4831-83f9-bb52a7e6182d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:48.984128 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abddbb-4411-4bac-9128-f3e21b892be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:48.984977 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abddbb-4411-4bac-9128-f3e21b892be1 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:48.985422 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abddbb-4411-4bac-9128-f3e21b892be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:48.985697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abddbb-4411-4bac-9128-f3e21b892be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:48.986768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abddbb-4411-4bac-9128-f3e21b892be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:51:48.987202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abddbb-4411-4bac-9128-f3e21b892be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:49.014391 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abddbb-4411-4bac-9128-f3e21b892be1 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:49.030076 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1383/2783] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:51:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:51:49.038019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f506bd-b753-4cf5-ae58-8190b0e5a010 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:49.051766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f506bd-b753-4cf5-ae58-8190b0e5a010 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:49.057212 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25842b8-f7d2-4b17-ae5b-e31a09a68ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:49.057827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25842b8-f7d2-4b17-ae5b-e31a09a68ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:49.058160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25842b8-f7d2-4b17-ae5b-e31a09a68ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:49.058437 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25842b8-f7d2-4b17-ae5b-e31a09a68ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:49.059106 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25842b8-f7d2-4b17-ae5b-e31a09a68ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:49.086614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25842b8-f7d2-4b17-ae5b-e31a09a68ea5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:49.122899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1401/2784] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:49 2021] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:49.127510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abddbb-4411-4bac-9128-f3e21b892be1 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:49.139178 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abddbb-4411-4bac-9128-f3e21b892be1 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:49.215020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23990ad-ab54-4aea-a749-6158c26685df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:49.215665 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23990ad-ab54-4aea-a749-6158c26685df admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:49.215947 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23990ad-ab54-4aea-a749-6158c26685df admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:49.216249 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23990ad-ab54-4aea-a749-6158c26685df admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:49.216926 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23990ad-ab54-4aea-a749-6158c26685df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:49.244052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23990ad-ab54-4aea-a749-6158c26685df admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:49.267172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1384/2785] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:49 2021] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 16 14:51:49.273165 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25842b8-f7d2-4b17-ae5b-e31a09a68ea5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:49.286354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25842b8-f7d2-4b17-ae5b-e31a09a68ea5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:49.291083 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39edc-d8f0-4bd2-af9d-d0217adf8ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:49.291678 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39edc-d8f0-4bd2-af9d-d0217adf8ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:49.291964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39edc-d8f0-4bd2-af9d-d0217adf8ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:49.292243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39edc-d8f0-4bd2-af9d-d0217adf8ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:49.292932 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39edc-d8f0-4bd2-af9d-d0217adf8ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:49.319797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39edc-d8f0-4bd2-af9d-d0217adf8ab0 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:49.333120 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1402/2786] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:49 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:49.339688 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23990ad-ab54-4aea-a749-6158c26685df admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:49.354934 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23990ad-ab54-4aea-a749-6158c26685df admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:49.360095 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1559e9-981d-4010-a595-8003a698ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:49.360954 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1559e9-981d-4010-a595-8003a698ccf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:49.361237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1559e9-981d-4010-a595-8003a698ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:49.361517 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1559e9-981d-4010-a595-8003a698ccf3 admin admin] PATH_INFO: `/v3/projects/163c4144e34143689d27fddc00e13e07/users/e548b17a2cf54b219f9b5ea0c141a975/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:49.386387 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1559e9-981d-4010-a595-8003a698ccf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163c4144e34143689d27fddc00e13e07, user_id=e548b17a2cf54b219f9b5ea0c141a975, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:49.414479 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1559e9-981d-4010-a595-8003a698ccf3 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:49.429964 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1385/2787] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:49 2021] PUT /identity/v3/projects/163c4144e34143689d27fddc00e13e07/users/e548b17a2cf54b219f9b5ea0c141a975/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:49.440940 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af20d4-05c6-489f-9fa5-0efb7ff10f5a None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:49.441405 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af20d4-05c6-489f-9fa5-0efb7ff10f5a None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:49.441573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af20d4-05c6-489f-9fa5-0efb7ff10f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:49.485938 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-c8af20d4-05c6-489f-9fa5-0efb7ff10f5a None None] MFA Rules not processed for user `e548b17a2cf54b219f9b5ea0c141a975`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:49.487614 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-c8af20d4-05c6-489f-9fa5-0efb7ff10f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:49.579774 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1403/2788] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:49 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:49.585022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1559e9-981d-4010-a595-8003a698ccf3 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:49.659051 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1559e9-981d-4010-a595-8003a698ccf3 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:49.668953 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448957a0-456b-4e7e-aa90-8b447042617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:49.670336 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448957a0-456b-4e7e-aa90-8b447042617b admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:49.670831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448957a0-456b-4e7e-aa90-8b447042617b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:49.671307 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448957a0-456b-4e7e-aa90-8b447042617b admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:49.672465 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448957a0-456b-4e7e-aa90-8b447042617b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:49.716022 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448957a0-456b-4e7e-aa90-8b447042617b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:49.748392 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1386/2789] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:49 2021] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:49.755331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af20d4-05c6-489f-9fa5-0efb7ff10f5a None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:49.765892 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af20d4-05c6-489f-9fa5-0efb7ff10f5a None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:49.842414 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798df0f-e0e2-4da4-b8c6-b4555b44fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:49.843036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798df0f-e0e2-4da4-b8c6-b4555b44fd65 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:49.843321 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798df0f-e0e2-4da4-b8c6-b4555b44fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:49.843599 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798df0f-e0e2-4da4-b8c6-b4555b44fd65 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:49.844237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798df0f-e0e2-4da4-b8c6-b4555b44fd65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:49.871204 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798df0f-e0e2-4da4-b8c6-b4555b44fd65 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:49.893410 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1404/2790] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:49 2021] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:49.899153 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448957a0-456b-4e7e-aa90-8b447042617b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:49.913647 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448957a0-456b-4e7e-aa90-8b447042617b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:49.919037 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aadac-e839-4b0e-914a-2d9ec8057ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:49.919714 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aadac-e839-4b0e-914a-2d9ec8057ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:49.920007 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aadac-e839-4b0e-914a-2d9ec8057ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:49.920319 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aadac-e839-4b0e-914a-2d9ec8057ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:49.921080 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aadac-e839-4b0e-914a-2d9ec8057ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:49.949568 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aadac-e839-4b0e-914a-2d9ec8057ef0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:49.963144 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1387/2791] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:49 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:51:49.968772 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798df0f-e0e2-4da4-b8c6-b4555b44fd65 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:49.982043 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798df0f-e0e2-4da4-b8c6-b4555b44fd65 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:49.989446 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234e349-1c47-4ef2-8bdc-1d256fc66f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:49.990719 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e349-1c47-4ef2-8bdc-1d256fc66f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:49.991058 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e349-1c47-4ef2-8bdc-1d256fc66f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:49.991477 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e349-1c47-4ef2-8bdc-1d256fc66f2a admin admin] PATH_INFO: `/v3/projects/c863555cf78e4050a50f7fb0a80cf85a/users/43ea24d3dcdd43f0a80202296f131f10/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:50.018886 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234e349-1c47-4ef2-8bdc-1d256fc66f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c863555cf78e4050a50f7fb0a80cf85a, user_id=43ea24d3dcdd43f0a80202296f131f10, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:50.046421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234e349-1c47-4ef2-8bdc-1d256fc66f2a admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:50.064724 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1405/2792] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:49 2021] PUT /identity/v3/projects/c863555cf78e4050a50f7fb0a80cf85a/users/43ea24d3dcdd43f0a80202296f131f10/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:50.078887 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328c85d-f693-441d-a1e1-2f7da1c03e6e None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:50.079180 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328c85d-f693-441d-a1e1-2f7da1c03e6e None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:50.079530 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328c85d-f693-441d-a1e1-2f7da1c03e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:50.125160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-6328c85d-f693-441d-a1e1-2f7da1c03e6e None None] MFA Rules not processed for user `43ea24d3dcdd43f0a80202296f131f10`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:50.126497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-6328c85d-f693-441d-a1e1-2f7da1c03e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:50.216931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1388/2793] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:50 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:50.221692 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234e349-1c47-4ef2-8bdc-1d256fc66f2a admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:50.307102 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234e349-1c47-4ef2-8bdc-1d256fc66f2a admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:50.312119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fdcbf-2c63-45df-a146-03c66f252aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:50.312739 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fdcbf-2c63-45df-a146-03c66f252aeb admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:50.313029 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fdcbf-2c63-45df-a146-03c66f252aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:50.313320 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fdcbf-2c63-45df-a146-03c66f252aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:50.313969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fdcbf-2c63-45df-a146-03c66f252aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:50.341392 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fdcbf-2c63-45df-a146-03c66f252aeb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:50.374669 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1406/2794] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:51:50 2021] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:50.381787 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328c85d-f693-441d-a1e1-2f7da1c03e6e None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:50.395481 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328c85d-f693-441d-a1e1-2f7da1c03e6e None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:50.467643 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bdf4e-ba03-4160-9e38-34df95b1661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:50.468240 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdf4e-ba03-4160-9e38-34df95b1661a admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:50.468553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdf4e-ba03-4160-9e38-34df95b1661a admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:50.468851 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdf4e-ba03-4160-9e38-34df95b1661a admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:50.469474 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bdf4e-ba03-4160-9e38-34df95b1661a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:50.498489 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bdf4e-ba03-4160-9e38-34df95b1661a admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:50.522853 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1389/2795] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:51:50 2021] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:51:50.527119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fdcbf-2c63-45df-a146-03c66f252aeb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:50.538122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fdcbf-2c63-45df-a146-03c66f252aeb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:50.542832 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bee54f-d8a7-48ac-9e18-0c0d89ce6740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:50.543437 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bee54f-d8a7-48ac-9e18-0c0d89ce6740 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:50.543718 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bee54f-d8a7-48ac-9e18-0c0d89ce6740 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:50.543995 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bee54f-d8a7-48ac-9e18-0c0d89ce6740 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:50.544720 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bee54f-d8a7-48ac-9e18-0c0d89ce6740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:50.571584 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bee54f-d8a7-48ac-9e18-0c0d89ce6740 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:50.585811 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1407/2796] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:50 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:51:50.593463 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bdf4e-ba03-4160-9e38-34df95b1661a admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:50.607015 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bdf4e-ba03-4160-9e38-34df95b1661a admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:50.611593 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a9efd-bc0d-49db-a4bb-cfca00ac0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:50.612439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a9efd-bc0d-49db-a4bb-cfca00ac0e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:50.612716 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a9efd-bc0d-49db-a4bb-cfca00ac0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:50.613053 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a9efd-bc0d-49db-a4bb-cfca00ac0e01 admin admin] PATH_INFO: `/v3/projects/89139c96d40d4c929622fc565915f92a/users/44ef134053f84aad91715fdf3820232a/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:50.638965 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a9efd-bc0d-49db-a4bb-cfca00ac0e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89139c96d40d4c929622fc565915f92a, user_id=44ef134053f84aad91715fdf3820232a, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:50.667837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a9efd-bc0d-49db-a4bb-cfca00ac0e01 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:50.682609 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1390/2797] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:50 2021] PUT /identity/v3/projects/89139c96d40d4c929622fc565915f92a/users/44ef134053f84aad91715fdf3820232a/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:50.687277 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bee54f-d8a7-48ac-9e18-0c0d89ce6740 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:50.698173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bee54f-d8a7-48ac-9e18-0c0d89ce6740 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:50.777095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b49b0-5c89-4b52-80b3-ea7dc95becb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:50.777602 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b49b0-5c89-4b52-80b3-ea7dc95becb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:50.777918 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b49b0-5c89-4b52-80b3-ea7dc95becb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:50.778245 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b49b0-5c89-4b52-80b3-ea7dc95becb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:50.778969 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b49b0-5c89-4b52-80b3-ea7dc95becb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:50.805773 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b49b0-5c89-4b52-80b3-ea7dc95becb6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:50.819936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1408/2798] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:50 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:51:50.824486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a9efd-bc0d-49db-a4bb-cfca00ac0e01 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:50.837173 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a9efd-bc0d-49db-a4bb-cfca00ac0e01 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:50.842811 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc38211-ce08-438e-ad56-18320c8f260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:50.843874 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc38211-ce08-438e-ad56-18320c8f260f admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:50.844195 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc38211-ce08-438e-ad56-18320c8f260f admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:50.844458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc38211-ce08-438e-ad56-18320c8f260f admin admin] PATH_INFO: `/v3/projects/89139c96d40d4c929622fc565915f92a/users/44ef134053f84aad91715fdf3820232a/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:50.846925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc38211-ce08-438e-ad56-18320c8f260f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89139c96d40d4c929622fc565915f92a, user_id=44ef134053f84aad91715fdf3820232a, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:50.873889 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc38211-ce08-438e-ad56-18320c8f260f admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:50.885812 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1391/2799] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:50 2021] PUT /identity/v3/projects/89139c96d40d4c929622fc565915f92a/users/44ef134053f84aad91715fdf3820232a/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:50.890418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b49b0-5c89-4b52-80b3-ea7dc95becb6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:50.905814 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b49b0-5c89-4b52-80b3-ea7dc95becb6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:50.982361 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782547c-aec0-491a-8585-c6911686d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:50.982985 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782547c-aec0-491a-8585-c6911686d243 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:50.983266 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782547c-aec0-491a-8585-c6911686d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:50.983553 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782547c-aec0-491a-8585-c6911686d243 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:50.984262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782547c-aec0-491a-8585-c6911686d243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:51.011010 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782547c-aec0-491a-8585-c6911686d243 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:51.023684 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1409/2800] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:51:50 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:51:51.028142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc38211-ce08-438e-ad56-18320c8f260f admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:51.039836 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc38211-ce08-438e-ad56-18320c8f260f admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:51.045522 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd1e3-96ad-4a48-9936-7ff1d52265d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:51.046439 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd1e3-96ad-4a48-9936-7ff1d52265d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:51.046734 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd1e3-96ad-4a48-9936-7ff1d52265d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:51.047011 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd1e3-96ad-4a48-9936-7ff1d52265d6 admin admin] PATH_INFO: `/v3/projects/89139c96d40d4c929622fc565915f92a/users/44ef134053f84aad91715fdf3820232a/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:51.048891 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fd1e3-96ad-4a48-9936-7ff1d52265d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89139c96d40d4c929622fc565915f92a, user_id=44ef134053f84aad91715fdf3820232a, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:51.077233 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fd1e3-96ad-4a48-9936-7ff1d52265d6 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:51.098987 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1392/2801] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:51:51 2021] PUT /identity/v3/projects/89139c96d40d4c929622fc565915f92a/users/44ef134053f84aad91715fdf3820232a/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:51.110995 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaac7d9-fd99-47b6-9de9-2c345c938174 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:51.111631 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaac7d9-fd99-47b6-9de9-2c345c938174 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:51.111764 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaac7d9-fd99-47b6-9de9-2c345c938174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:51.157537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-acaac7d9-fd99-47b6-9de9-2c345c938174 None None] MFA Rules not processed for user `44ef134053f84aad91715fdf3820232a`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:51.158771 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-acaac7d9-fd99-47b6-9de9-2c345c938174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:51.255742 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1410/2802] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:51 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:51.266745 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd1e3-96ad-4a48-9936-7ff1d52265d6 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:51.268589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b52fd1e3-96ad-4a48-9936-7ff1d52265d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:51.343433 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd1e3-96ad-4a48-9936-7ff1d52265d6 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:51.349245 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379e1de-71ed-4c3e-8a1f-bfce3e0c68ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:51.349888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379e1de-71ed-4c3e-8a1f-bfce3e0c68ef service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:51.350238 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379e1de-71ed-4c3e-8a1f-bfce3e0c68ef service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:51.350514 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379e1de-71ed-4c3e-8a1f-bfce3e0c68ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:51.436480 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379e1de-71ed-4c3e-8a1f-bfce3e0c68ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:51.465408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379e1de-71ed-4c3e-8a1f-bfce3e0c68ef service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:51.476936 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1393/2803] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:51 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:53.319380 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaac7d9-fd99-47b6-9de9-2c345c938174 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:53.320948 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-acaac7d9-fd99-47b6-9de9-2c345c938174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:53.333591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaac7d9-fd99-47b6-9de9-2c345c938174 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:53.337240 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1e60b-98c4-439a-b9a8-1e45cc6ec821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:53.337827 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1e60b-98c4-439a-b9a8-1e45cc6ec821 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:53.338140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1e60b-98c4-439a-b9a8-1e45cc6ec821 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:53.338424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1e60b-98c4-439a-b9a8-1e45cc6ec821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:53.412618 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1e60b-98c4-439a-b9a8-1e45cc6ec821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:53.438177 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1e60b-98c4-439a-b9a8-1e45cc6ec821 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:53.448425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1411/2804] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:53 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:54.227428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379e1de-71ed-4c3e-8a1f-bfce3e0c68ef service cinder] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:54.236309 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379e1de-71ed-4c3e-8a1f-bfce3e0c68ef service cinder] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:54.239967 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ed3a-6a68-49da-a560-0f2f5e1a9ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:54.240573 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ed3a-6a68-49da-a560-0f2f5e1a9ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:54.240850 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ed3a-6a68-49da-a560-0f2f5e1a9ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:54.241120 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ed3a-6a68-49da-a560-0f2f5e1a9ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:54.250588 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60ed3a-6a68-49da-a560-0f2f5e1a9ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:54.276111 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60ed3a-6a68-49da-a560-0f2f5e1a9ee6 service cinder] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:54.286651 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1394/2805] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:54 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:59.049252 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1e60b-98c4-439a-b9a8-1e45cc6ec821 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:59.127186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1e60b-98c4-439a-b9a8-1e45cc6ec821 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:59.132256 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:59.140568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.140568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.140568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] PATH_INFO: `/v3/users/e548b17a2cf54b219f9b5ea0c141a975` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.140568 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e548b17a2cf54b219f9b5ea0c141a975)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:59.161976 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:59.230323 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e548b17a2cf54b219f9b5ea0c141a975'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.238292 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e548b17a2cf54b219f9b5ea0c141a975'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.239572 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e548b17a2cf54b219f9b5ea0c141a975'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.249863 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e548b17a2cf54b219f9b5ea0c141a975'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.269447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e548b17a2cf54b219f9b5ea0c141a975'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:51:59.277757 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1412/2806] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:51:59 2021] DELETE /identity/v3/users/e548b17a2cf54b219f9b5ea0c141a975 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:51:59.282750 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b36239-85d0-4275-927f-3d8a5c40e2a8 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.283337 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b36239-85d0-4275-927f-3d8a5c40e2a8 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.283618 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b36239-85d0-4275-927f-3d8a5c40e2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.308118 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-64b36239-85d0-4275-927f-3d8a5c40e2a8 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:51:59.309213 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-64b36239-85d0-4275-927f-3d8a5c40e2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:59.377956 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1395/2807] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:51:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:51:59.388941 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:59.390365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:59.458399 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc5271-683a-4971-b366-94c1c4906a7e admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:59.461974 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f64d0-08d0-4dd7-921f-213b230419c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:59.462603 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f64d0-08d0-4dd7-921f-213b230419c1 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.462888 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f64d0-08d0-4dd7-921f-213b230419c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.463156 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f64d0-08d0-4dd7-921f-213b230419c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.474861 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f64d0-08d0-4dd7-921f-213b230419c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:59.506026 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f64d0-08d0-4dd7-921f-213b230419c1 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:51:59.518648 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1413/2808] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:51:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:51:59.919621 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b36239-85d0-4275-927f-3d8a5c40e2a8 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:51:59.921157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-64b36239-85d0-4275-927f-3d8a5c40e2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:51:59.933476 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b36239-85d0-4275-927f-3d8a5c40e2a8 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:51:59.938276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:51:59.939082 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:51:59.939365 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:51:59.939639 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] PATH_INFO: `/v3/projects/163c4144e34143689d27fddc00e13e07` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:51:59.941097 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163c4144e34143689d27fddc00e13e07)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:51:59.967566 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.023400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163c4144e34143689d27fddc00e13e07', 'request_id': 'req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.034944 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163c4144e34143689d27fddc00e13e07', 'request_id': 'req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.043645 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163c4144e34143689d27fddc00e13e07', 'request_id': 'req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.054497 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] The token cache is being invalidate because project 163c4144e34143689d27fddc00e13e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:52:00.054776 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.055431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.057024 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1396/2809] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:51:59 2021] DELETE /identity/v3/projects/163c4144e34143689d27fddc00e13e07 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:00.061105 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f64d0-08d0-4dd7-921f-213b230419c1 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.076279 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f64d0-08d0-4dd7-921f-213b230419c1 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.158571 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.159418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.159667 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.159946 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] PATH_INFO: `/v3/users/43ea24d3dcdd43f0a80202296f131f10` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.161715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ea24d3dcdd43f0a80202296f131f10)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:00.188573 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.246072 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ea24d3dcdd43f0a80202296f131f10'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.253936 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ea24d3dcdd43f0a80202296f131f10'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.254644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ea24d3dcdd43f0a80202296f131f10'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.262912 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ea24d3dcdd43f0a80202296f131f10'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.275157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ea24d3dcdd43f0a80202296f131f10'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.281035 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1414/2810] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:52:00 2021] DELETE /identity/v3/users/43ea24d3dcdd43f0a80202296f131f10 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:00.672237 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.674047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:00.687368 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30957716-1e8e-4ebd-bf5d-ab62b84d89c2 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.754280 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.755093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.755376 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.755650 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] PATH_INFO: `/v3/projects/c863555cf78e4050a50f7fb0a80cf85a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.756888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c863555cf78e4050a50f7fb0a80cf85a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:00.782724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:00.837010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c863555cf78e4050a50f7fb0a80cf85a', 'request_id': 'req-37d9f74f-2598-4bba-84bb-eec790c9e2b0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.849373 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c863555cf78e4050a50f7fb0a80cf85a', 'request_id': 'req-37d9f74f-2598-4bba-84bb-eec790c9e2b0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.856960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c863555cf78e4050a50f7fb0a80cf85a', 'request_id': 'req-37d9f74f-2598-4bba-84bb-eec790c9e2b0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.867679 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] The token cache is being invalidate because project c863555cf78e4050a50f7fb0a80cf85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:52:00.867942 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.868596 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:00.870071 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1397/2811] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:52:00 2021] DELETE /identity/v3/projects/c863555cf78e4050a50f7fb0a80cf85a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:00.874324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:00.875930 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:00.888590 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790028-63b4-4456-9c55-ff7cd544362f admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:00.957367 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:00.958151 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:00.958424 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:00.958700 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] PATH_INFO: `/v3/users/44ef134053f84aad91715fdf3820232a` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:00.959830 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ef134053f84aad91715fdf3820232a)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:00.985459 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:01.038876 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ef134053f84aad91715fdf3820232a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.047192 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ef134053f84aad91715fdf3820232a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.048262 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ef134053f84aad91715fdf3820232a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.057745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ef134053f84aad91715fdf3820232a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.071883 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-017b966c-48df-4981-ab83-1af35a525fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ef134053f84aad91715fdf3820232a'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.079119 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1415/2812] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:52:00 2021] DELETE /identity/v3/users/44ef134053f84aad91715fdf3820232a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:01.492659 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:01.494328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:01.507278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9f74f-2598-4bba-84bb-eec790c9e2b0 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:01.573771 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:01.574636 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:01.574907 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:01.575179 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] PATH_INFO: `/v3/projects/89139c96d40d4c929622fc565915f92a` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:01.576340 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89139c96d40d4c929622fc565915f92a)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:01.602304 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:01.657670 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89139c96d40d4c929622fc565915f92a', 'request_id': 'req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.670483 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89139c96d40d4c929622fc565915f92a', 'request_id': 'req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.680267 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89139c96d40d4c929622fc565915f92a', 'request_id': 'req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.691731 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] The token cache is being invalidate because project 89139c96d40d4c929622fc565915f92a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:52:01.692010 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.692698 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-2ecb892d-4ef7-42cd-bd90-1a41c558f3f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:52:01.694405 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1398/2813] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:52:01 2021] DELETE /identity/v3/projects/89139c96d40d4c929622fc565915f92a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:01.702382 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9373-6064-47de-9734-3a1ea763d61f None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:01.702723 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9373-6064-47de-9734-3a1ea763d61f None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:01.702986 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9373-6064-47de-9734-3a1ea763d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:01.726790 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-ebac9373-6064-47de-9734-3a1ea763d61f None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:01.728080 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-ebac9373-6064-47de-9734-3a1ea763d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:01.799721 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1416/2814] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:52:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:01.808542 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9ed2-e312-4103-b8cf-c8b6f3fd97df None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:01.808871 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9ed2-e312-4103-b8cf-c8b6f3fd97df None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:01.809210 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9ed2-e312-4103-b8cf-c8b6f3fd97df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:01.835229 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-2a1a9ed2-e312-4103-b8cf-c8b6f3fd97df None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:01.837157 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2a1a9ed2-e312-4103-b8cf-c8b6f3fd97df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:01.845083 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1399/2815] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:52:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:01.849958 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9373-6064-47de-9734-3a1ea763d61f None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:01.859348 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9373-6064-47de-9734-3a1ea763d61f None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:01.863770 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ed495-be0d-463f-88a3-78eda8038efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:01.864365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ed495-be0d-463f-88a3-78eda8038efb admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:01.864642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ed495-be0d-463f-88a3-78eda8038efb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:01.864935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ed495-be0d-463f-88a3-78eda8038efb admin admin] PATH_INFO: `/v3/domains` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:01.865613 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ed495-be0d-463f-88a3-78eda8038efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Dec 16 14:52:01.865898 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ed495-be0d-463f-88a3-78eda8038efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:01.891418 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ed495-be0d-463f-88a3-78eda8038efb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:01.905466 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1417/2816] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Dec 16 14:52:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 16 14:52:01.910405 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a9ed2-e312-4103-b8cf-c8b6f3fd97df None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:01.920232 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a9ed2-e312-4103-b8cf-c8b6f3fd97df None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:01.925212 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a8d6f-528c-4bef-8aef-24c208e38b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:01.925813 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a8d6f-528c-4bef-8aef-24c208e38b1c admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:01.926137 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a8d6f-528c-4bef-8aef-24c208e38b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:01.926416 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a8d6f-528c-4bef-8aef-24c208e38b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:01.927088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a8d6f-528c-4bef-8aef-24c208e38b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:01.953324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a8d6f-528c-4bef-8aef-24c208e38b1c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:01.983366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1400/2817] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:52:01 2021] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:01.988364 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ed495-be0d-463f-88a3-78eda8038efb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:01.999008 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ed495-be0d-463f-88a3-78eda8038efb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:02.069003 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6996ba6-677d-4c4b-81ac-90df498d7f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:02.069526 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996ba6-677d-4c4b-81ac-90df498d7f07 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:02.069813 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996ba6-677d-4c4b-81ac-90df498d7f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:02.070127 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996ba6-677d-4c4b-81ac-90df498d7f07 admin admin] PATH_INFO: `/v3/users` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:02.070766 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6996ba6-677d-4c4b-81ac-90df498d7f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:02.096625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6996ba6-677d-4c4b-81ac-90df498d7f07 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:02.123527 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1418/2818] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:52:01 2021] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:02.124379 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a8d6f-528c-4bef-8aef-24c208e38b1c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:02.135431 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a8d6f-528c-4bef-8aef-24c208e38b1c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:02.139899 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3c87a-eebf-4a84-aec6-5ddafb9e2f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:02.140589 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c87a-eebf-4a84-aec6-5ddafb9e2f22 admin admin] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:02.140880 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c87a-eebf-4a84-aec6-5ddafb9e2f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:02.141158 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c87a-eebf-4a84-aec6-5ddafb9e2f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:02.141867 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3c87a-eebf-4a84-aec6-5ddafb9e2f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:02.168656 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3c87a-eebf-4a84-aec6-5ddafb9e2f22 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:02.180092 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1401/2819] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:02 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:52:02.184722 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6996ba6-677d-4c4b-81ac-90df498d7f07 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:02.196999 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6996ba6-677d-4c4b-81ac-90df498d7f07 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:02.202089 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd10e07-7041-487a-bc01-f74ba74467bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:02.202991 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd10e07-7041-487a-bc01-f74ba74467bb admin admin] REQUEST_METHOD: `PUT` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:02.203288 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd10e07-7041-487a-bc01-f74ba74467bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:02.203574 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd10e07-7041-487a-bc01-f74ba74467bb admin admin] PATH_INFO: `/v3/projects/cc24679d241c4fc5ad847e4dd6d68cc7/users/7499170b07074cb2aa9319c0c7a119ee/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:02.226050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd10e07-7041-487a-bc01-f74ba74467bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc24679d241c4fc5ad847e4dd6d68cc7, user_id=7499170b07074cb2aa9319c0c7a119ee, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:02.252702 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd10e07-7041-487a-bc01-f74ba74467bb admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:02.268147 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1419/2820] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:02 2021] PUT /identity/v3/projects/cc24679d241c4fc5ad847e4dd6d68cc7/users/7499170b07074cb2aa9319c0c7a119ee/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:02.273709 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7ce7c-da8d-46ff-96c9-b08e65396080 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:02.274088 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7ce7c-da8d-46ff-96c9-b08e65396080 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:02.274362 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7ce7c-da8d-46ff-96c9-b08e65396080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:02.297723 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b1a7ce7c-da8d-46ff-96c9-b08e65396080 None None] MFA Rules not processed for user `69b3dce5d565425ca928deea4c6b8503`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:02.298925 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b1a7ce7c-da8d-46ff-96c9-b08e65396080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:02.372831 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1402/2821] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:52:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:02.387750 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd10e07-7041-487a-bc01-f74ba74467bb admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:02.389739 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-0cd10e07-7041-487a-bc01-f74ba74467bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:02.461184 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd10e07-7041-487a-bc01-f74ba74467bb admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:02.464626 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b095a63-6dab-4299-838e-0f09e5d1f096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:02.465237 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b095a63-6dab-4299-838e-0f09e5d1f096 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:02.465517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b095a63-6dab-4299-838e-0f09e5d1f096 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:02.465791 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b095a63-6dab-4299-838e-0f09e5d1f096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:02.475736 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b095a63-6dab-4299-838e-0f09e5d1f096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:02.501313 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b095a63-6dab-4299-838e-0f09e5d1f096 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:02.512160 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1420/2822] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:07.937829 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737d115-2976-4777-ac2d-487f25b27a2d None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:07.938777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737d115-2976-4777-ac2d-487f25b27a2d None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:07.938939 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737d115-2976-4777-ac2d-487f25b27a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:07.980804 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-2737d115-2976-4777-ac2d-487f25b27a2d None None] MFA Rules not processed for user `7499170b07074cb2aa9319c0c7a119ee`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:07.982055 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-2737d115-2976-4777-ac2d-487f25b27a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:08.104719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1403/2823] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:52:07 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:08.109366 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b095a63-6dab-4299-838e-0f09e5d1f096 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:08.120659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b095a63-6dab-4299-838e-0f09e5d1f096 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:08.131835 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf061b-2146-494e-9c06-49865033e3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:08.132470 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf061b-2146-494e-9c06-49865033e3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:08.132794 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf061b-2146-494e-9c06-49865033e3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:08.133354 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf061b-2146-494e-9c06-49865033e3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:08.134324 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf061b-2146-494e-9c06-49865033e3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:08.184508 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf061b-2146-494e-9c06-49865033e3c6 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:08.218186 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1421/2824] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Dec 16 14:52:08 2021] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:08.223313 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737d115-2976-4777-ac2d-487f25b27a2d None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:08.236192 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737d115-2976-4777-ac2d-487f25b27a2d None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:08.326429 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c1cd3-e78d-4ebb-9395-bee42a8c237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:08.327315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c1cd3-e78d-4ebb-9395-bee42a8c237c admin admin] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:08.327597 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c1cd3-e78d-4ebb-9395-bee42a8c237c admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:08.327992 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c1cd3-e78d-4ebb-9395-bee42a8c237c admin admin] PATH_INFO: `/v3/users` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:08.328648 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c1cd3-e78d-4ebb-9395-bee42a8c237c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:08.355735 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c1cd3-e78d-4ebb-9395-bee42a8c237c admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:08.380189 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1404/2825] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Dec 16 14:52:08 2021] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 16 14:52:08.384383 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf061b-2146-494e-9c06-49865033e3c6 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:08.396161 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf061b-2146-494e-9c06-49865033e3c6 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:08.401304 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ced35-1b96-4932-95ad-b04f42f97379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:08.402236 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ced35-1b96-4932-95ad-b04f42f97379 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:08.402644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ced35-1b96-4932-95ad-b04f42f97379 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:08.403100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ced35-1b96-4932-95ad-b04f42f97379 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:08.403915 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ced35-1b96-4932-95ad-b04f42f97379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:08.430185 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ced35-1b96-4932-95ad-b04f42f97379 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:08.442088 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1422/2826] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:08 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 16 14:52:08.446290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c1cd3-e78d-4ebb-9395-bee42a8c237c admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:08.456837 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c1cd3-e78d-4ebb-9395-bee42a8c237c admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:08.461892 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873a716-146f-4b2c-9c4d-74b975917d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:08.463063 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873a716-146f-4b2c-9c4d-74b975917d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:08.463697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873a716-146f-4b2c-9c4d-74b975917d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:08.463974 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873a716-146f-4b2c-9c4d-74b975917d1b admin admin] PATH_INFO: `/v3/projects/495cca0a6a6847fcb34196aab4ffc8dc/users/502d5239f8d8437db2d32eb09196259d/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:08.492290 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873a716-146f-4b2c-9c4d-74b975917d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=495cca0a6a6847fcb34196aab4ffc8dc, user_id=502d5239f8d8437db2d32eb09196259d, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:08.520173 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873a716-146f-4b2c-9c4d-74b975917d1b admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:08.536782 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1405/2827] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:08 2021] PUT /identity/v3/projects/495cca0a6a6847fcb34196aab4ffc8dc/users/502d5239f8d8437db2d32eb09196259d/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:52:08.540474 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ced35-1b96-4932-95ad-b04f42f97379 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:08.551854 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ced35-1b96-4932-95ad-b04f42f97379 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:08.626519 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efed62-8a08-4d1d-84f7-b3124d36fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:08.627243 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efed62-8a08-4d1d-84f7-b3124d36fd85 admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:08.627642 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efed62-8a08-4d1d-84f7-b3124d36fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:08.628014 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efed62-8a08-4d1d-84f7-b3124d36fd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:08.628911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efed62-8a08-4d1d-84f7-b3124d36fd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:08.654925 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efed62-8a08-4d1d-84f7-b3124d36fd85 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:08.667271 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1423/2828] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:08 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:52:08.671930 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873a716-146f-4b2c-9c4d-74b975917d1b admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:08.685093 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873a716-146f-4b2c-9c4d-74b975917d1b admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:08.691103 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97c0b-39a6-4702-9649-3b16b61767bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:08.692062 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97c0b-39a6-4702-9649-3b16b61767bf admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:08.692434 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97c0b-39a6-4702-9649-3b16b61767bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:08.693019 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97c0b-39a6-4702-9649-3b16b61767bf admin admin] PATH_INFO: `/v3/projects/495cca0a6a6847fcb34196aab4ffc8dc/users/502d5239f8d8437db2d32eb09196259d/roles/df1ba7f919104bd2849e19b7d341df4d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:08.695981 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba97c0b-39a6-4702-9649-3b16b61767bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=495cca0a6a6847fcb34196aab4ffc8dc, user_id=502d5239f8d8437db2d32eb09196259d, role_id=df1ba7f919104bd2849e19b7d341df4d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:08.723671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba97c0b-39a6-4702-9649-3b16b61767bf admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:08.735719 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1406/2829] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:08 2021] PUT /identity/v3/projects/495cca0a6a6847fcb34196aab4ffc8dc/users/502d5239f8d8437db2d32eb09196259d/roles/df1ba7f919104bd2849e19b7d341df4d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:52:08.739792 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efed62-8a08-4d1d-84f7-b3124d36fd85 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:08.749745 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efed62-8a08-4d1d-84f7-b3124d36fd85 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:08.817209 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd732fd-5a8b-49e4-80ec-a63fa502942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:08.817823 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd732fd-5a8b-49e4-80ec-a63fa502942e admin admin] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:08.818140 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd732fd-5a8b-49e4-80ec-a63fa502942e admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:08.818421 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd732fd-5a8b-49e4-80ec-a63fa502942e admin admin] PATH_INFO: `/v3/roles` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:08.819142 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd732fd-5a8b-49e4-80ec-a63fa502942e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:08.845075 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd732fd-5a8b-49e4-80ec-a63fa502942e admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:08.856398 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1424/2830] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Dec 16 14:52:08 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 16 14:52:08.860667 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97c0b-39a6-4702-9649-3b16b61767bf admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:08.871324 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97c0b-39a6-4702-9649-3b16b61767bf admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:08.875950 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787495fa-7744-40e5-bdb4-10045b877146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:08.876860 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787495fa-7744-40e5-bdb4-10045b877146 admin admin] REQUEST_METHOD: `PUT` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:08.877112 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787495fa-7744-40e5-bdb4-10045b877146 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:08.877388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787495fa-7744-40e5-bdb4-10045b877146 admin admin] PATH_INFO: `/v3/projects/495cca0a6a6847fcb34196aab4ffc8dc/users/502d5239f8d8437db2d32eb09196259d/roles/a5fff0138d624c8e8151601f7ad2edb9` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:08.879315 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787495fa-7744-40e5-bdb4-10045b877146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495cca0a6a6847fcb34196aab4ffc8dc, user_id=502d5239f8d8437db2d32eb09196259d, role_id=a5fff0138d624c8e8151601f7ad2edb9)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:08.905671 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787495fa-7744-40e5-bdb4-10045b877146 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:08.921918 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1407/2831] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Dec 16 14:52:08 2021] PUT /identity/v3/projects/495cca0a6a6847fcb34196aab4ffc8dc/users/502d5239f8d8437db2d32eb09196259d/roles/a5fff0138d624c8e8151601f7ad2edb9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:52:14.326108 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef1e1b-ae79-4a23-ab83-e3db209eb375 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:14.326756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef1e1b-ae79-4a23-ab83-e3db209eb375 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:14.326756 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef1e1b-ae79-4a23-ab83-e3db209eb375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:14.367836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-5aef1e1b-ae79-4a23-ab83-e3db209eb375 None None] MFA Rules not processed for user `502d5239f8d8437db2d32eb09196259d`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:14.369494 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-5aef1e1b-ae79-4a23-ab83-e3db209eb375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:14.463486 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1425/2832] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:52:14 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:14.475273 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787495fa-7744-40e5-bdb4-10045b877146 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:14.476995 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-787495fa-7744-40e5-bdb4-10045b877146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:14.591553 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787495fa-7744-40e5-bdb4-10045b877146 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:14.596815 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b2f67-aace-497c-a99e-5a362d1df17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:14.597421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b2f67-aace-497c-a99e-5a362d1df17e service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:14.597702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b2f67-aace-497c-a99e-5a362d1df17e service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:14.597980 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b2f67-aace-497c-a99e-5a362d1df17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:14.664018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b2f67-aace-497c-a99e-5a362d1df17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:14.690123 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b2f67-aace-497c-a99e-5a362d1df17e service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:14.701052 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1408/2833] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:14 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:38.925870 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefeb0c-73c8-433d-989b-b4360b45c712 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:38.926492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefeb0c-73c8-433d-989b-b4360b45c712 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:38.926492 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefeb0c-73c8-433d-989b-b4360b45c712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:38.954274 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-acefeb0c-73c8-433d-989b-b4360b45c712 None None] MFA Rules not processed for user `7499170b07074cb2aa9319c0c7a119ee`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:52:38.955591 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-acefeb0c-73c8-433d-989b-b4360b45c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:38.963365 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1426/2834] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:52:38 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:52:39.556030 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b2f67-aace-497c-a99e-5a362d1df17e service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:39.557763 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-cc0b2f67-aace-497c-a99e-5a362d1df17e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:39.625877 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b2f67-aace-497c-a99e-5a362d1df17e service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:39.629512 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610815dd-b5a5-45da-9b65-73efc2d266c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:39.630121 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610815dd-b5a5-45da-9b65-73efc2d266c1 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:39.630378 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610815dd-b5a5-45da-9b65-73efc2d266c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:39.630742 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610815dd-b5a5-45da-9b65-73efc2d266c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:39.632674 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-610815dd-b5a5-45da-9b65-73efc2d266c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:39.643255 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610815dd-b5a5-45da-9b65-73efc2d266c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:39.668973 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610815dd-b5a5-45da-9b65-73efc2d266c1 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:39.678257 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1409/2835] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:39 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:46.031109 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefeb0c-73c8-433d-989b-b4360b45c712 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:46.042654 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefeb0c-73c8-433d-989b-b4360b45c712 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:46.046458 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390cbd3-b3e7-4c00-b5be-887b0ccb7c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:46.047059 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390cbd3-b3e7-4c00-b5be-887b0ccb7c28 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:46.047343 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390cbd3-b3e7-4c00-b5be-887b0ccb7c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:46.047625 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390cbd3-b3e7-4c00-b5be-887b0ccb7c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:46.059765 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390cbd3-b3e7-4c00-b5be-887b0ccb7c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:46.085189 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390cbd3-b3e7-4c00-b5be-887b0ccb7c28 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:46.097191 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1427/2836] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:46 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:52:53.836549 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610815dd-b5a5-45da-9b65-73efc2d266c1 service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:52:53.845864 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610815dd-b5a5-45da-9b65-73efc2d266c1 service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:52:53.850712 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186e57-4271-4b6e-92df-0e5ddf29f43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:52:53.850913 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186e57-4271-4b6e-92df-0e5ddf29f43d service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:52:53.851129 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186e57-4271-4b6e-92df-0e5ddf29f43d service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:52:53.851408 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e186e57-4271-4b6e-92df-0e5ddf29f43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:52:53.853472 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-1e186e57-4271-4b6e-92df-0e5ddf29f43d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:52:53.868327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e186e57-4271-4b6e-92df-0e5ddf29f43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:52:53.894388 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e186e57-4271-4b6e-92df-0e5ddf29f43d service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:52:53.906466 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1410/2837] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:52:53 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:53:00.636181 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390cbd3-b3e7-4c00-b5be-887b0ccb7c28 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:53:00.645126 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390cbd3-b3e7-4c00-b5be-887b0ccb7c28 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:53:00.648829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2693f-7db7-44c4-865b-3063d25ddda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:53:00.649391 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2693f-7db7-44c4-865b-3063d25ddda7 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:53:00.649659 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2693f-7db7-44c4-865b-3063d25ddda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:53:00.649935 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2693f-7db7-44c4-865b-3063d25ddda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:53:00.658952 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2693f-7db7-44c4-865b-3063d25ddda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:53:00.684760 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2693f-7db7-44c4-865b-3063d25ddda7 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:53:00.695036 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1428/2838] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:53:00 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:53:50.790041 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186e57-4271-4b6e-92df-0e5ddf29f43d service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:53:50.801677 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e186e57-4271-4b6e-92df-0e5ddf29f43d service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:53:50.805486 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:53:50.806100 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:53:50.806382 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:53:50.806650 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:53:50.809400 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:53:50.819917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:53:50.846707 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:53:50.856655 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1411/2839] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:53:50 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 16 14:55:33.275608 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885db6ab-3fcc-45d5-bfc3-fa789e72eef0 None None] REQUEST_METHOD: `POST` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:55:33.276644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885db6ab-3fcc-45d5-bfc3-fa789e72eef0 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:55:33.276644 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885db6ab-3fcc-45d5-bfc3-fa789e72eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:55:33.303301 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.auth.core [None req-885db6ab-3fcc-45d5-bfc3-fa789e72eef0 None None] MFA Rules not processed for user `7499170b07074cb2aa9319c0c7a119ee`. Rule list: `[]` (Enabled: `True`). {{(pid=66112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:55:33.304558 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-885db6ab-3fcc-45d5-bfc3-fa789e72eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:55:33.312687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1429/2840] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:55:33 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:55:34.543327 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:55:34.544843 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:55:34.627384 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ed8cc-c603-4001-abda-ea61a9b300ab service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:55:34.632035 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5fa36-ba1f-4740-bd1e-f1f134e49ed9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:55:34.632628 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5fa36-ba1f-4740-bd1e-f1f134e49ed9 service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:55:34.632908 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5fa36-ba1f-4740-bd1e-f1f134e49ed9 service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:55:34.633187 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5fa36-ba1f-4740-bd1e-f1f134e49ed9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:55:34.635147 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-28e5fa36-ba1f-4740-bd1e-f1f134e49ed9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:55:34.646767 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5fa36-ba1f-4740-bd1e-f1f134e49ed9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:55:34.672594 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5fa36-ba1f-4740-bd1e-f1f134e49ed9 service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:55:34.682909 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1412/2841] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:55:34 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:55:34.849563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885db6ab-3fcc-45d5-bfc3-fa789e72eef0 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:55:34.851095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-885db6ab-3fcc-45d5-bfc3-fa789e72eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:55:34.867229 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885db6ab-3fcc-45d5-bfc3-fa789e72eef0 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:55:34.871797 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a907e-e181-4b00-97f6-3eaef1998da8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:55:34.872404 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a907e-e181-4b00-97f6-3eaef1998da8 service placement] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:55:34.872687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a907e-e181-4b00-97f6-3eaef1998da8 service placement] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:55:34.872964 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a907e-e181-4b00-97f6-3eaef1998da8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:55:34.874978 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-a64a907e-e181-4b00-97f6-3eaef1998da8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:55:34.887945 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a907e-e181-4b00-97f6-3eaef1998da8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:55:34.915295 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a907e-e181-4b00-97f6-3eaef1998da8 service placement] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:55:34.925688 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1430/2842] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:55:34 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:55:49.150126 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5fa36-ba1f-4740-bd1e-f1f134e49ed9 service placement] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:55:49.165428 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5fa36-ba1f-4740-bd1e-f1f134e49ed9 service placement] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:55:49.171949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc9677-e124-44a2-9ea6-12ad02d3c043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:55:49.172172 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc9677-e124-44a2-9ea6-12ad02d3c043 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:55:49.172449 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc9677-e124-44a2-9ea6-12ad02d3c043 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:55:49.172720 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc9677-e124-44a2-9ea6-12ad02d3c043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:55:49.174561 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-bdcc9677-e124-44a2-9ea6-12ad02d3c043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:55:49.187020 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc9677-e124-44a2-9ea6-12ad02d3c043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:55:49.213160 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc9677-e124-44a2-9ea6-12ad02d3c043 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:55:49.224768 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1413/2843] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:55:49 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:55:54.462125 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a907e-e181-4b00-97f6-3eaef1998da8 service placement] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:55:54.476267 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a907e-e181-4b00-97f6-3eaef1998da8 service placement] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:55:54.481331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:55:54.482019 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:55:54.482345 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:55:54.482619 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:55:54.484381 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:55:54.496282 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:55:54.521924 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:55:54.533808 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1431/2844] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:55:54 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:55:56.046366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc9677-e124-44a2-9ea6-12ad02d3c043 service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:55:56.058931 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc9677-e124-44a2-9ea6-12ad02d3c043 service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:55:56.064582 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db970fe0-b324-431a-a5ec-a8dd11deb1a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:55:56.065132 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db970fe0-b324-431a-a5ec-a8dd11deb1a6 service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:55:56.065418 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db970fe0-b324-431a-a5ec-a8dd11deb1a6 service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:55:56.065697 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db970fe0-b324-431a-a5ec-a8dd11deb1a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:55:56.067610 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-db970fe0-b324-431a-a5ec-a8dd11deb1a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:55:56.079196 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db970fe0-b324-431a-a5ec-a8dd11deb1a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:55:56.105217 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db970fe0-b324-431a-a5ec-a8dd11deb1a6 service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:55:56.116510 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1414/2845] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:55:56 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:57:44.567090 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:57:44.568577 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:57:44.641173 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb4493-d6e8-4edd-b9ee-6d8473b6ffb6 service nova] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:57:44.644911 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e5d9-f432-42a7-836e-a9f49ad97d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:57:44.645495 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e5d9-f432-42a7-836e-a9f49ad97d5a service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:57:44.645782 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e5d9-f432-42a7-836e-a9f49ad97d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:57:44.646100 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e5d9-f432-42a7-836e-a9f49ad97d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:57:44.655362 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e5d9-f432-42a7-836e-a9f49ad97d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:57:44.680777 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e5d9-f432-42a7-836e-a9f49ad97d5a service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:57:44.690689 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1432/2846] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:57:44 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:57:57.588228 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30797b0-41be-4813-84e0-1970204ddac6 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:57:57.588893 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30797b0-41be-4813-84e0-1970204ddac6 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:57:57.588893 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30797b0-41be-4813-84e0-1970204ddac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:57:57.614404 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-b30797b0-41be-4813-84e0-1970204ddac6 None None] MFA Rules not processed for user `7499170b07074cb2aa9319c0c7a119ee`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:57:57.615572 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-b30797b0-41be-4813-84e0-1970204ddac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:57:57.622702 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1415/2847] 10.222.0.67 () {58 vars in 957 bytes} [Thu Dec 16 14:57:57 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 16 14:57:57.698505 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e5d9-f432-42a7-836e-a9f49ad97d5a service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:57:57.700157 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-0df2e5d9-f432-42a7-836e-a9f49ad97d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:57:57.715393 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e5d9-f432-42a7-836e-a9f49ad97d5a service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:57:57.719862 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad651b3-d081-4fd9-9a0d-0be678271522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb089e686c2540bfadf60b8ea010e441', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:57:57.720447 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad651b3-d081-4fd9-9a0d-0be678271522 service cinder] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:57:57.720728 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad651b3-d081-4fd9-9a0d-0be678271522 service cinder] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:57:57.721005 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad651b3-d081-4fd9-9a0d-0be678271522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:57:57.732635 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad651b3-d081-4fd9-9a0d-0be678271522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:57:57.758647 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad651b3-d081-4fd9-9a0d-0be678271522 service cinder] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:57:57.770331 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1433/2848] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:57:57 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:57:58.206777 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30797b0-41be-4813-84e0-1970204ddac6 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:57:58.218827 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30797b0-41be-4813-84e0-1970204ddac6 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:57:58.222495 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742062df-60d2-4d42-95b4-5b62e63e77bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:57:58.223072 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742062df-60d2-4d42-95b4-5b62e63e77bc service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:57:58.223351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742062df-60d2-4d42-95b4-5b62e63e77bc service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:57:58.223624 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742062df-60d2-4d42-95b4-5b62e63e77bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:57:58.231567 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742062df-60d2-4d42-95b4-5b62e63e77bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:57:58.256968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742062df-60d2-4d42-95b4-5b62e63e77bc service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:57:58.266119 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1416/2849] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:57:58 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:57:58.913095 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad651b3-d081-4fd9-9a0d-0be678271522 service cinder] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:57:58.925829 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad651b3-d081-4fd9-9a0d-0be678271522 service cinder] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:57:58.928726 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6e021-8ff6-42af-8350-f8f0c983bedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:57:58.929306 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e021-8ff6-42af-8350-f8f0c983bedf service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:57:58.929633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e021-8ff6-42af-8350-f8f0c983bedf service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:57:58.929910 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e021-8ff6-42af-8350-f8f0c983bedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:57:58.941902 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6e021-8ff6-42af-8350-f8f0c983bedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:57:58.968546 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6e021-8ff6-42af-8350-f8f0c983bedf service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:57:58.980037 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1434/2850] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:57:58 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:58:55.702322 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742062df-60d2-4d42-95b4-5b62e63e77bc service neutron] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:58:55.712021 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742062df-60d2-4d42-95b4-5b62e63e77bc service neutron] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:58:55.716598 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cc61b-b9f6-419f-98ef-d3656ef76932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:58:55.717242 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cc61b-b9f6-419f-98ef-d3656ef76932 service neutron] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:58:55.717531 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cc61b-b9f6-419f-98ef-d3656ef76932 service neutron] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:58:55.717859 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cc61b-b9f6-419f-98ef-d3656ef76932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:58:55.726845 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cc61b-b9f6-419f-98ef-d3656ef76932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:58:55.752803 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cc61b-b9f6-419f-98ef-d3656ef76932 service neutron] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:58:55.762458 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1417/2851] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:58:55 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:59:01.126639 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a3eb9-8189-4472-8f8a-01746bfecc63 None None] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:59:01.127232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a3eb9-8189-4472-8f8a-01746bfecc63 None None] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:59:01.127232 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a3eb9-8189-4472-8f8a-01746bfecc63 None None] PATH_INFO: `/` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:59:01.128893 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1435/2852] 10.222.0.67 () {54 vars in 912 bytes} [Thu Dec 16 14:59:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 16 14:59:01.133983 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9eeda-46fe-443f-be74-69dc46098606 None None] REQUEST_METHOD: `POST` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:59:01.134461 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9eeda-46fe-443f-be74-69dc46098606 None None] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:59:01.134584 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9eeda-46fe-443f-be74-69dc46098606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:59:01.187724 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.auth.core [None req-86c9eeda-46fe-443f-be74-69dc46098606 None None] MFA Rules not processed for user `15e7b1dc56e949f2adb1744b492187a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 16 14:59:01.188879 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-86c9eeda-46fe-443f-be74-69dc46098606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:59:01.196917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1418/2853] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Dec 16 14:59:01 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 16 14:59:01.215054 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a3eb9-8189-4472-8f8a-01746bfecc63 None None] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:59:01.229637 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a3eb9-8189-4472-8f8a-01746bfecc63 None None] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:59:01.234923 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bcb0-46ad-4890-8c8f-fda156340409 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:59:01.235537 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bcb0-46ad-4890-8c8f-fda156340409 service placement] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:59:01.235824 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bcb0-46ad-4890-8c8f-fda156340409 service placement] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:59:01.236106 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bcb0-46ad-4890-8c8f-fda156340409 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:59:01.245062 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bcb0-46ad-4890-8c8f-fda156340409 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:59:01.278338 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bcb0-46ad-4890-8c8f-fda156340409 service placement] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:59:01.290290 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1436/2854] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:59:01 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:59:09.857518 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9eeda-46fe-443f-be74-69dc46098606 None None] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:59:09.872535 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9eeda-46fe-443f-be74-69dc46098606 None None] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:59:09.882175 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073e19-e6f8-4fa6-a51e-9c0715f19c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2bcc9f013f14ed89f5e94591f170b7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:59:09.883013 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073e19-e6f8-4fa6-a51e-9c0715f19c04 service nova] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:59:09.883440 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073e19-e6f8-4fa6-a51e-9c0715f19c04 service nova] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:59:09.883919 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073e19-e6f8-4fa6-a51e-9c0715f19c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:59:09.886473 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-53073e19-e6f8-4fa6-a51e-9c0715f19c04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:59:09.900141 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53073e19-e6f8-4fa6-a51e-9c0715f19c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:59:09.935328 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53073e19-e6f8-4fa6-a51e-9c0715f19c04 service nova] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:59:09.946754 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1419/2855] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:59:09 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:59:15.727575 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bcb0-46ad-4890-8c8f-fda156340409 service placement] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:59:15.737975 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bcb0-46ad-4890-8c8f-fda156340409 service placement] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:59:15.748451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e247e-ddb1-475d-a248-be5302dbaff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20905ef1afa847bc8f2f6f6e335f8bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:59:15.748451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e247e-ddb1-475d-a248-be5302dbaff9 service neutron] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:59:15.748451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e247e-ddb1-475d-a248-be5302dbaff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:59:15.748451 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e247e-ddb1-475d-a248-be5302dbaff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:59:15.819657 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e247e-ddb1-475d-a248-be5302dbaff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:59:15.846633 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e247e-ddb1-475d-a248-be5302dbaff9 service neutron] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:59:15.857468 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1437/2856] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 14:59:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 14:59:28.276421 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073e19-e6f8-4fa6-a51e-9c0715f19c04 service nova] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:59:28.287413 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073e19-e6f8-4fa6-a51e-9c0715f19c04 service nova] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:59:28.292502 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:59:28.293333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:59:28.293617 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:59:28.293933 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] PATH_INFO: `/v3/users/7499170b07074cb2aa9319c0c7a119ee` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:59:28.295135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7499170b07074cb2aa9319c0c7a119ee)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:59:28.321181 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:59:28.380220 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7499170b07074cb2aa9319c0c7a119ee'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.394142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7499170b07074cb2aa9319c0c7a119ee'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.404145 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7499170b07074cb2aa9319c0c7a119ee'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.404968 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7499170b07074cb2aa9319c0c7a119ee'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.415251 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7499170b07074cb2aa9319c0c7a119ee'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.423247 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1420/2857] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:59:28 2021] DELETE /identity/v3/users/7499170b07074cb2aa9319c0c7a119ee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:59:28.679251 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e247e-ddb1-475d-a248-be5302dbaff9 service neutron] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:59:28.689124 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e247e-ddb1-475d-a248-be5302dbaff9 service neutron] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:59:28.766050 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:59:28.766879 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:59:28.767164 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:59:28.767441 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] PATH_INFO: `/v3/projects/cc24679d241c4fc5ad847e4dd6d68cc7` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:59:28.768687 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc24679d241c4fc5ad847e4dd6d68cc7)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:59:28.794500 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:59:28.845899 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'request_id': 'req-3da26f11-e15b-413e-829b-d22dbd5118d5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.857453 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'request_id': 'req-3da26f11-e15b-413e-829b-d22dbd5118d5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.866166 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc24679d241c4fc5ad847e4dd6d68cc7', 'request_id': 'req-3da26f11-e15b-413e-829b-d22dbd5118d5'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.876027 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] The token cache is being invalidate because project cc24679d241c4fc5ad847e4dd6d68cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:59:28.876310 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.876931 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:28.878425 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1438/2858] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:59:28 2021] DELETE /identity/v3/projects/cc24679d241c4fc5ad847e4dd6d68cc7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 14:59:28.883125 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:59:28.884835 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:59:28.898047 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904947b7-9057-4087-985b-63d94f1fd6b8 admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:59:28.966027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:59:28.966858 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:59:28.967139 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:59:28.967464 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] PATH_INFO: `/v3/users/502d5239f8d8437db2d32eb09196259d` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:59:28.968976 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=502d5239f8d8437db2d32eb09196259d)` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:59:28.995136 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:59:29.048239 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502d5239f8d8437db2d32eb09196259d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.061775 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502d5239f8d8437db2d32eb09196259d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.070135 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502d5239f8d8437db2d32eb09196259d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.070888 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502d5239f8d8437db2d32eb09196259d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.080142 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.notifications [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502d5239f8d8437db2d32eb09196259d'} {{(pid=66113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.086917 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1421/2859] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Dec 16 14:59:28 2021] DELETE /identity/v3/users/502d5239f8d8437db2d32eb09196259d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 16 14:59:29.317706 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 14:59:29.319413 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 14:59:29.331517 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da26f11-e15b-413e-829b-d22dbd5118d5 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 14:59:29.398122 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b3dce5d565425ca928deea4c6b8503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccd5dcafb684ba88fe8fe109a2798be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 14:59:29.398836 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 14:59:29.399116 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 14:59:29.399388 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] PATH_INFO: `/v3/projects/495cca0a6a6847fcb34196aab4ffc8dc` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 14:59:29.400485 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495cca0a6a6847fcb34196aab4ffc8dc)` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 14:59:29.426259 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 14:59:29.477651 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495cca0a6a6847fcb34196aab4ffc8dc', 'request_id': 'req-b89ceb2a-cbf8-4b59-9ce1-10784f068412'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.491347 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495cca0a6a6847fcb34196aab4ffc8dc', 'request_id': 'req-b89ceb2a-cbf8-4b59-9ce1-10784f068412'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.500176 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495cca0a6a6847fcb34196aab4ffc8dc', 'request_id': 'req-b89ceb2a-cbf8-4b59-9ce1-10784f068412'} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.513715 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] The token cache is being invalidate because project 495cca0a6a6847fcb34196aab4ffc8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 16 14:59:29.514073 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.514693 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.notifications [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 16 14:59:29.516448 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1439/2860] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Dec 16 14:59:29 2021] DELETE /identity/v3/projects/495cca0a6a6847fcb34196aab4ffc8dc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 16 15:00:59.755286 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 15:00:59.757202 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 15:00:59.943959 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c85b-d233-4901-85d1-6f50216c60dd admin admin] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 15:01:00.023849 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 15:01:00.024441 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 15:01:00.024733 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 15:01:00.025018 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 15:01:00.027075 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 15:01:00.041033 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 15:01:00.078949 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 15:01:00.090027 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1422/2861] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 15:00:59 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 15:01:01.030247 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] Authenticating user token {{(pid=66112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 15:01:01.031822 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 15:01:01.090534 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ceb2a-cbf8-4b59-9ce1-10784f068412 admin admin] Validating token access rules against request {{(pid=66112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 15:01:01.101730 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a50b03-4ad0-4bb1-b7d6-7eb4bcb1d02b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 15:01:01.103691 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50b03-4ad0-4bb1-b7d6-7eb4bcb1d02b service placement] REQUEST_METHOD: `GET` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 15:01:01.104428 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50b03-4ad0-4bb1-b7d6-7eb4bcb1d02b service placement] SCRIPT_NAME: `/identity` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 15:01:01.105416 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a50b03-4ad0-4bb1-b7d6-7eb4bcb1d02b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 15:01:01.110623 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.fernet_utils [None req-91a50b03-4ad0-4bb1-b7d6-7eb4bcb1d02b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 15:01:01.137129 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a50b03-4ad0-4bb1-b7d6-7eb4bcb1d02b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 15:01:01.186302 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a50b03-4ad0-4bb1-b7d6-7eb4bcb1d02b service placement] RBAC: Authorization granted {{(pid=66112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 15:01:01.198563 dv-cinder-821893-3-iscsi devstack@keystone.service[66112]: [pid: 66112|app: 0|req: 1440/2862] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 15:01:01 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 16 15:01:01.236580 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] Authenticating user token {{(pid=66113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 16 15:01:01.238174 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 15:01:01.251351 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890f0f8-4d2d-44b0-a84b-3b7fe6836868 service placement] Validating token access rules against request {{(pid=66113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 16 15:01:01.257366 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d2dd7-5f58-4513-927a-d1937558c5e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15e7b1dc56e949f2adb1744b492187a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6d18cf4033c4cf3992edc7b1939b8d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 16 15:01:01.257960 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d2dd7-5f58-4513-927a-d1937558c5e1 service placement] REQUEST_METHOD: `GET` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 16 15:01:01.258276 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d2dd7-5f58-4513-927a-d1937558c5e1 service placement] SCRIPT_NAME: `/identity` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 16 15:01:01.258558 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d2dd7-5f58-4513-927a-d1937558c5e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 16 15:01:01.260278 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.fernet_utils [None req-842d2dd7-5f58-4513-927a-d1937558c5e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 16 15:01:01.273333 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d2dd7-5f58-4513-927a-d1937558c5e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Dec 16 15:01:01.303927 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d2dd7-5f58-4513-927a-d1937558c5e1 service placement] RBAC: Authorization granted {{(pid=66113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 16 15:01:01.315225 dv-cinder-821893-3-iscsi devstack@keystone.service[66113]: [pid: 66113|app: 0|req: 1423/2863] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Dec 16 15:01:01 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)